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I. INTRODUCTION « 

% ft 

Issues of competency and accountability dominate the tone of life in the 
Uhited States. Fr.cm the Pres identMn aHe Oval Office to N the teacher in the 
rural schoolhouse cone the same questions: Wat have wo acconpl i shed? Were 
have we failed? Wy have 'our results been less than we planned? Wo is 
responsible for our degree* 6f. acconpl i shment or failure? Can w* change the 
situation for thej&etter? How can we tell if we actually are making improve- 
ments? Wat arc trying to acconpl ish*, anyway? » ; 



Nowhere are these questions being asked more earnestly than by those who 
focus on' public school education in the United States. They are asked on 
National Teacher Examinations (NT£), Scholastic Aptitute Tests (SAT) , state- 
created tests of teachers and students, within teacher certification and 
eval^atjon procedures, and through the use of myriad other measures and 
combinations of measures. The questions ar$ always there — who is account- 
able? for what is s/he accountable? who is competent?^ in what skills is s/he 

« 

competent?. 

Faced with taxpayers 1 revolts, increased interest in private school educa- 

t 

tion, and the rising anger of students and parents who feel they haven't 
received their due, public schools are finding themselves anxious to respond to 
questions of competency and accoun tab i I i ty in a sensible, thoughtful , and 
accurate way. Their need to make a reasoned analysis of the problems is, 
however, often in conflfct with pdbllc pressure. Fer example, a recent 
Newsweek poll conducted by the Gal JLug^Organrtatlon shows that 89% of those 

r 

surveyed believe that "teachers should be required to pass a competency test 
before they are hired*" (Newsweek, April 27, 1981, p. 79) Of course, it is 
left to others to determine what a. 1 vaj id teacher competency test might be. 1 



The "others 1 that most often have to solve the teacher conpetencles 
dilemma, as -well" as 'the student accountability puzzle, are the employees of 
state education agencies. Because the state education agency (SEA) generally 
concerns itself with teacher certification, school accreditation, and 
accountabil |\y standards, it must seek and test solutions to competency and 
accountability problems While being sensitive to public demands and legislative 
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imperatives — not an env iable* pos i tion. 

The Regional Planning and Service Project (RPSP) of the SouthwesJ J=aiisa-_ 
-t-h>nar Development Latrorato>y *(SEDL) has had a continuing interest in the 
progress of its client state education agencies toward workable competency and 

t 

accountability policies and procedures.. Since 1978, the project has been 

y ' , 
instrumental in bringing its *s fx SEAs 1 together to discuss issues and share 

^ ideas with each other and with noted national advisors in the yesfs of conpe- 
tency and accountability in education in the -U.S. The Invitational Symposlun 

i 

* on Usues of Competency and Accountability, held May >1 3-1 4, 1981, marked the 
third time In three years that these thorny problems have been taken "up for 
discussion by RPSP members, 2 and such frequency is certainly an indication , of 
their importance to the region 1 s educat ional pol icymakers. Thi s document, 
Proceedings £f am invitational Symposium on Issues of Competency an<k 
Accountability , May 13-14, 1581, surmarlzes the di scuss ions and presentations! 
of six SEA representatives, im\ee national advisors, RPSP staff and other 
participants (see Appendix B) over an intense eight^hour period. ■ 



1 Arkansas, Louisiana, Mississippi, New Mexico, Oklahoma, arid Texas 

2 Issues in Minimum Competency Testing and Competency-Based Education , the 
proceedings of an invitational symposium held in February; 1978 in New 
Orleans, Louisiana, and Issues in Educational' Accountabil ity , report of, a 
symposlun in~August of that year in Oklahoma- City, Oklahoma are ajso 
available. 



The three advisors were: 

Elaine Lindheim , Director of Teit Development at Instructional 
Objectives Exchange in Culver City, California, vrcrks on 
crdter ion-referenced measures of student competency and wys to use 
such measures as a positive force to improve instruction. She has 
worked with local school districts in California and in Detroit to 
"customize" instructional material and criterion-referenced measures 
and wijh the states of Texas, Virginia, South Carolina, Maryland, New 
Hampshire and Connecticut on the practical impl ementat iorr of state or 
local mandates. 

t 

As Senior Research Psychologist andChairman of The Teacher Behavior 
Research Group at Educational Jest fog Service, Fred McDonald works 
extensively on models for assessing competency using student tests. 
He relates ttiiswork to basic policy issues such as measuring teacher 
effect iveness and improving teacher • eduation. Dr. McDonald also 
serves as Director of Accoun tab! I i ty Research in New York City and 
Chairman of the Drafting Committee of the Newrnn Commission, and he 
endfltts research on and evaluation of teachers in New York City and 
with the Mianvi-Dade School District. 



Dlani Pul I in , *ho holds' both* a law degree and a Ph.D. in Education . 
and who has served as an intern in testing. As staff attorney for the 
Center for Law & Education in Ohbridge, Massachusetts, she re- 
presented student* in, the Debra P. vs. Turl ington case in which she • 

.successful ly questioned the test-for-graduation requirement in 
Florida. She has consul ted th " studen^ groups on other potential 
cases and i s a participant in a N IE-sponsored debate clarifying 
issue! of minfcnum competency that is expected to be televised soon. 

Closely fo I lowing , the organization "of the symposiun itself, .the Pro- 
ceedings include the fol lowing- di scussions. 

J 

• A Review of State Legislatures 1 Actions and of * States Agencies 1 . 
Pol icies Regarding Competency and Acfcountb il I ty 

♦ 

• Issues in the Region (a simrarry of the issues suggested by the six- 
state review) ♦ 

• Responses of the National Advisors (the views of each of the three 
presentors reflecting their specific expertise and their reactions, to 
the six-state neview) m * 

* \ 

• Perspectives on 4 Ccmpe tency and Accountability (a surlLry of the inter- 
action among Jt he participants) 

• Synthesis and Conclusions (an outline of the most significant" features 
of the symposium *nd conclusions such a synthesis implies) 
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"A eearching examination... ehould In made of 
every child in every eohool. . tV ith the viea to 
aeoerjotning whether theec indnpeneable ele- 
ment^ of knowledge ore thoroughly acquired and 
to make^he proepecteand position of th$ 
teachere dependent to a ooneiderabie extent on 
the reeulte of thie examinatCon." 

Mevcaetle Ccnnxttion, WS# 



Thie 'payment by reeulte' eyetem it a 

'gar* of mechanical contrivance in t/hiah the 
teacher* vill and mitt. . learn ho» to beat ut 
(eohool inepeotor*)] ' 

X - Hatthev Arnold. 1999 



Txaminatione are formidable even to the bee t 
prrpar+d, for the greatest fool may aek more 
than the vteeet nanfban aneuer " 

C.C. ColtonC 1820 
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About ttie Presentors 



Elaine Llndheiro tt Director of Test Develop- t 
•em* «t Instructional Objectives Exchange In 
Culver C 1 1 / . (ilifcmli where she work* _<*> 
criterion- referenced ■e**ure* of student camp/- 
tency aoA ways to 'use such «e»sures as • 
positive force to f improve Instruction She has , 
.woAed with localUchool districts In California 
and In Detroit/to 'custoslie' Instructional 
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with the states of Jexas. Virginia. South 
Carolina, Maryland . New Hempsh Ire and Connecticut 
on the practical Implementation of sUte or 1oca| 
mind* tes , 

As Senior Research ^Psychologist and Chairman 
of the Teacher Behavior Research Group at Educa- 
tional Testing Service. Fred .McDonald »«rks 
extensively on Models for assessing competency 
using student tests- He relates this wor* to 
basic policy Issues such as Measuring teacher 
effectiveness and improving teacher education. 
McDonald also serves as Olrector of Account. 
Ity Research In «ch for* City and Chairman 
Drafting Comelttee of the Hewman Comnls- 
slon, and he conducts research on and evaluation , 
of teath^rs I" Hew Tort and with the MleMl-Oede , 
School Oistrlct. 

Diana Pullln has both a law degree and a Ph.D 
In Education md has served as an Intern In ^ 
testing As staff attorney for the Center for 
law and Education in Cambridge, Massachusetts, 
she represented 'students In the Pebra P. v 
Turlington case In*wh1ch she successfully oues- , 
Honed* the test- for.graduatlon requirement in 
florid*. She has consulted with student groups 
on other potential cases and Is a participant in 
a HU-sponsored debatfe cUrlfylng Issues of- 
■InlwuM competency that Is expected to be tele- 
vised this fall. 
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The Regional Planning end Service Pro|ect 
of the Southwest Educational Development labora- 
tory provides assistance In planning to educa- 
tion^ pollcy.wkers In the Hastate region of 
Arkansas, Louisiana* Mississippi, hew Mexico. 
Ofclahomi, and lexas Funded by the national In- 
stitute of Education, the project has three prl- 
wry objectives (1) to generate and provide 
Information for policy analysis, planning, and 
decision-Making, {2) to provide access to ex- 
perts In policy and planning areas, and (3) to 
provide, continuing assistance In high priority- 
planning and policy-making areas. P.rlmiry cli- 
ents are the Chief SUte Schoof Officers, their 
settlor Managers, and other selected pollcy-mak- 
ers In the six states 

These objectives *re retched through a variety 
of activities Including- dls tr I bytt on of 
selected da U banks and lnfpriMtlort-*+ources, 
policy analyses ant planning documents, publi- 
cation of policy analysis papers/and treTras 
Monitorlnnjiewsletters ; formal and Informal 
consultation sessions with experts on critical 
educatlonel^pollcy Issues, state-wide problems, 
and state-level roles, and on going consulta* 
lion in analysis of problem, Identification of 
alternative solution strategies, and mapping of 
responses. The objectives are congruent with 
the Laboratory coMMltment to regional service 
and to the N«tfdMl Institute of Education com* ^ 
Mltment to technical assistance to the region 
and facilitation of cbmwunlcatlon among, educa- 
tional agencies and individuals in the region. 
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It. A REVIEW OF STATE LEGISLATURES' ACTIONS « 

AND OF STATE AGENCIES* POLICIES 
REGARDING COMPETENCY AND ACCOUNTABILITY, r 

The 1981 synposlun began with a review of the status of conpetency and 
accountability 4n the six-state region of. the SEDL Regional Planning and- 
Service Project. Each state representative Qurllned his ^tate's legislative 
and procedural view of conpetency and accountability and respondecTto questions 
fron symposiim par t Ic I pants. The candid state sunrar les wtifch resulted 
revealed different approaches — even different definitions — guiding-each of 
the states in Its efforts to respond to crucial Issues. 

' In the following outline of each SEA representative's renarks) legisla- 
tion and procedures regarding student conpetency and accountability **re 
considered \irst and are followed by legislation and procedures regarding 
teacher conpetency And accountability. <Cb ! s approach does not necessarily 
reflect the order selected by tfie Individual speaker but does reflect the 
content and tone of h i s j prfcsentat ion 





ARKANSAS Dr. Sherman Peterson 

Associate Director for Instructional Services' 
Arkansas] C^par tment of Education 

COMPETENCY AND ACCOUNTABILITY — A <MRH) RESPONS IBILITY WITH THE LOCAL 

EDUCAT ION AGEN3Y 

* 

The Arkansas Department of Education operates under legal and implied 
res pons 1 b 1 1 1 1 1 es for '^educational accountabi I i ty which are assumed by" "the 
Director of the Department. Serving at the ^pl easur e ,of the Governor and 
fl^>nsible to the State Board of Education, the Director of the Arkansas SEA 
must enforce and fairly administer educational laws enacted by the General 
Assembly and regulations established by the State Board of Education. Although 
"there is no one in the Arkansas Department of Education vyho has either the 
specific assignment nor is there a staff established for the purpose to work on 
education accountability full-time," 1 it is clear frcm the mission of the 
Department of Education that many staff members must share the concern for both 
student and teacher ccrfipetenc ies and accountability. The mission of the 
Department of Education is to: * • 

• provide adequate and equal educational opportunity .to every child in 
Arkansas; 

• strengthen and improve elementary, secondary, adult and vocational- 
technical* education in Arkansas; 

• provide enlightened professional leadership, guidance, and supervision 
of the state school system; 

• provide and di ss^rninate factual information pertinent to pUb I ic 
education to mentoers of the teaching profession and to the public; 

• ^ seek the advice, counsel and thinking of "people from al I. walks of life,, 

as well as the teaching profession, in the formation of regulatory and 
administrative policie*s; ' ' t 

• encourage local boards of education to assume and to exercise the 
control of education within their ccmmunities in accordance with the 
statutes; and 

< o 

• contribute to the strengthening of educational personnel. z 
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Accordingly, several SEA staff menrbers have worked actively to Influence legis- 
lation In conpetency and accountability matters ,so that their efforts in 
serving the SEA mission would be further supported by enacted law. As many 
SEAs across the nation have done, the Arkansas SEA has collected the account- 
ability legislation of other, states, and it has carefully monitored court 
challenges and judicial opinions regarding that legislation. Guided by these 
precedents and the belief that educational accountability is a responsibility 
shared by marty people and organizations involved in formal education, the 
Arkansas SEA is formulating procedures which conform to the following legal 
mandates. ^ 
Student Competency and Accountabfl irfr 

In 1977, the Arkansas General Assembly formally authorized the State Board 
of Education to } "establish educational goals for the pdblic schools of the 
state." 3 According to Act 484 of 1977, the State Board of Education, working 
through the Department of Education, would establish minimi™ performance goals 
in var ious "sdbject areas. Spec i f ical I y men t ion I ng re,adi ng , the Act intended to 
place a priority on basic skills. To involve a variety of people across 

4 

Arkansas, Act 484 also mandated that hearings across the state take place as 
* v 

the minimim performance goals were being set. The hearings were conducted and 
eventually min imun performance goals were accepted for trial in grades three 
and six. 

* 

In support of the steps taken* toward the establishment of minimum 
perfo rmance goal s , the General Assembly next passed Act 666 of 1979, the 
Education Assessment Act. Requiring an annual assessment program in the public 
elcnentary and seconflary schools of the state, the Act provides -diagnost ic 

• ( 

informat ion to students, parents, teachers, and the SEA, and does not intend 
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to influence students' grade pi acmient or promotion." Spec if leal I Stated, the 
assessment program shall: • 

(a) measure pupil perfomiance in the basic subjects taught generally in 
the schools of the state; , \ 

. \ ' 

(b) provide data concerning the strengths and weaknesses of the instruc- 
tional programs of the various school districts in the state; ' 

(c) provide information to assist in planning education programs and 
identifying educational priorities; 

(d) provide teachers with diagnostic information; and , " 

(e) assess how we I I districts and schools are meeting state and school . 
district educational goals and minlnim performance goals. 4 ^ 

> 

To meet these objectives, Act 666 specified the outlines of a procedure to 
be used in initiating the hisses sment program and linking it to the minimum 
performance goals referred to in Act 484. The Act directed the Department of^ 
Education in the 1979-80 school year, -to obtain a status quo evajuation of 
students in grades three, six and eight Wing . standardized tests. In the 
meantime, the Department was also to develop minimum performance goals for 
grade eight and make appropriate revisions, in already established goals for 
grades three and six. With all of these goals established, the Department was 
then ^dated to develop appropriate criterion-referenced tests. Validation of 
these tests was to begin in the spring of'l979-80 and continue through the 
1980-81 school year. Appropriate gr ade-l evel - teachers were- to be actively 
involved in all phases^of this process. By the 198U1982 school year, "the 
^-minimum performance tests will be administered to students in grades three, 
six, and eight. ..and annually tjiereafter f * These tests will, be used for 

-diagnostic purposes and will not- be used to determine grade placement or* for 

promotion of pupils. 

As of this time, the Arkansas Department of Education has been able to 

meet its timeline. The SRA test was administered to\ al I students in grade four 

is " 
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and to a sanr^l e of grades thr*e, *i;c, and *ight in the spring of the 1979-80 
school year, and work^ proceeds now. on establishing the validity pf the minimim 
performance tests *h ich . wer e -subsequent! y developed by SEA and LEA (local-* 
education agency) staff.. As indicated in Act 666, the revision of minimim 
perfo.rmance g6al s and, therefore, the revision of minfcmm performance tests, is 
to be a continuing task of the Depar tment , ^wi th minimum performance goals to 
undergo review by the State Board* of Educat ion* every five years. ' y • 

Remarks of Sympos iun Participants * 

Q: Do you forsee any additional use of your testing results in the 
future? 

A: No, no one is talking about that. 

Q: How much additional staff have you been able to hire to fulfill your 

new. obi igat ions? ^ s 

A: Three people — 2 professional educators and* one se'cretary^A 

Teacher Competency and Accountability 

Currently, across the state of Arkansas, there is interest in teacher 

preparation as well as in student outcomes. Act 162 of 1979 authorized the 

State Board of Education to set *down rules and regulations for teacher ~— 

certification. , 

The law requires'persons applying for the initial certification 
• and those teachers holding a valid certificate desiring cerifi- 
cation in an additional area to complete the National Teachers 
Examination or a. comparable examination developed or' selected 
by the State Board. The State Board selected the National 
Teacher's Examination since no funding was provided to build a 
comparable examination.^ * 

^ • 

Applicants have been required to complete the National Teacher's Examination 
since January 1, 1980. Currently, under an anendment to Section 1 of Act 162 
of 1979 (Act 814 of 1981), the State board of Education is evaluating the 
performance of Arkansas techer certification appl icants " on • the NTE. ^fl/ • 
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. February 1, 1983, the Board-must set the level at which the examination is 
satisfactorily completed for the purpose^ certification as" 'a' teacher in the 
state of Arkansas. After that date, "no applicant for . initial certi fication or 
certification in r an additional area shall receive a .certi f icate unless She 
appl leant scores at or above the minhuin level, set by the Board."? , ^ 
The Department of Education is also turning- its attention to the encour- 

. ■ ' 

agement of increased continuing education at the local' schoof level/ UhUke 
i ■ 
, many states such as Mississippi, Texas, and West Virginia, Arkansas has no 

-mandatory number of staff development days which either compose an acceptable 

school year or qualify a school di s^ct for accreditation. There is interest 

in Arkansas in the fur therTevel opment of continuing educat ion c I asses focused 

on local teacher needs -as it -is thought that such inservice could' be more 

relevant than university courses. To pi I s end, the Department of Education 

hopes to sponsor more state-directed workshops which will include training 

related to both school accredi tatibn and foiprovement of specific student 

. n - v 

.skills. Also supporting local school efforts are plans, "for establishing 
resource centers in three geographic '^cations in the state. Various state 
services will be shifted .or transferred to the Centers where they will be more 
accessible to local school distr lets."* ' Add! tional inservice is anticipated ' 
with the establishment of -executive academies sponsored by the Department of 
Education. , These academi es v wi I I provide Straining' opportunities in school 
administration tc^ practicing -administrators.!^ 

-* ■ . 

Remarks of Sympos tun Part i c tpants 

' / 

Yodhave told us that 'the NTE will be used to ' 'determine teacher 
certification, wm i t al„so be used diagnost ical ly? 
A: Indirectly, but it will be very difficult. Since rhere ane central 
testint centers, applicants do not necessacily take the exam at thk 
universities which provided their training. Without being able to 
dlrec/ly associate every -student with his/her alma mater, we cannot 
p^ovdde any real guidance. to teacher training institutions. 
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Q: Regarding locally produced continuing education program — how are 
you going to exercise quality control of the wide range of programs 
that will be produced across the state? 
A: B/ producing state-directed model workshops related to the improvement 
of student sk*il Is. 

A: (Mississippi): We require each course outline to specify the amount 
of clock hours required to complete the work, and we require a 
specific description of the content. 

/ * * 

Arkansas References 

1. "Education Accountability in the Arkansas Oepar traent *of Education," A 
Position Paper from the Arkansas SEA, p. 1. 

2. Ibid , p. 3. The mission statement or iginal ly appears in the docunent, ^ 
DEPARTMENT CF EDUCAT ION Ml SS ION, OOU.S, PN) OBJECTIVES WITH SUPPORTING 

ACTIONS PL*NS, 1979. ' . O 

» ■* « 

t • ' 

3. Ibid , p. I . 

4. Act 666 of the Acts of Arkansas of 1979, Section 2, p. 1415. 

V ^ 

5. Mbid, p. 1417. . * . 

6. "Education Accountability in the Arkansas Department of Education," p. I. 

7. Act 814 of the Acts of Arkansas of 1981, Section 1, p. I. o I 



8. "Education Accountability in the Arkansas Department of Education," p. 4. 

9. Ibid, p. 4. ' 
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LOUISIANA Mr. David Hamilton 

* Section Chief, Legislative A Legal Analysis 

Louisiana Deparfrnent of Education 

•* CCMPETEfCYAND ACXDUNTABI LITY — MORE QUESTIONS THW ANSWERS 

: . Since 1977, students, parents, legislators and educators In Louisiana have 

been struggling with competency and accountability issues. Recognizing the 

need for .action, legislators and state education agency personnel have plunged 

Into pr ob I en-solving attempts, ofteo attracting region-wide and nationwide 

publicity. Today, with programs in place and-a sensitivity to the political 

influences on competency and accountability proposals, the Loui siana 'SEA 

continues to move toward , workabl e competency testing of students, and fair, 

realistic accountability procedures for teachers. The problem-solving con- 

. tinues and so does the reflection and self-questioning — \rtat does happen — 

♦ 

and what should happen — when this scores cone in? 

/ 

\ - 

Student Competency Testing 

As mandated, by law, the Loui siana Department of Education must set minimum 
standards or minimum mastery I evels for basic skills to be acquired at each , 
grade level, grades two-through twelve. These ski'l Is must also be measured - 
annually by competency tests created by the Department itself for Louisiana. 
In recognition of the slow process involved in developing workable standards 
and tests for each grade level, a three-year procedure has been developed. In 
the ffrst year, the standards are set and the test create*. A pi I or of the exam 
Is then run the second year, and appropriate revisions mad*. The test goes 
into effect the third, year. One grade level enters the process per year *o 
that eleven years will-be required for atl grades to be included in the minimun * 
standards -and thirteen years will, be required for al^l grades to be tested in 4 
£he specific competencies set foiHh. \ { 
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The Louisiana SEA has put an enphasis on using Tfrc studep-t assessment 
program to enhance compensation and remediation* Each parish. has-been required 
to jreate a Pupil Progression Plan(PPP) — that Is, to describe specifically 
the process through which the student wiil progress through the school systmu 
the PPP sboul d v include the measures uhich will.be under taken ^en student 

» 

deficiencies are detected. The ^EA has worked with each - paiJ sh on its 

individual plan, and it is hoped that some standardization wl I I be evident when 

tfife plans are implemented during the 1981-82 school year. The >; impor tance of 

these pPins is such that ttfey wi I I be Required by the State-in order for the 

parish to receive state money. t • ~ ' * 

Remarks of Symposlun Participants 

Q: What grade levels have initiated standards and testing? 
A: Grades- three, eight, ^^e^^en. 

Q: What kinds of- results have yoji seen? ^ 

A: It is still eafly. ACT scores have gone up but the pr-ogran really 
hasn ! t been fin effect long epough to determine what influences it 
may have had on the scores. Also, Dr. Hugh Pexk, Assistant Super- 
intcmdep* for Research and Development, has some evidence that* 
1 ndl csar^es that poorer districts are showing more Improvement in. 
min imun c'onpetfcnc ies testing scores than*richer districts. 

A 

Teacher Accountability Procedures 

Considerably more of Loui si ana 1 Vat tent I on is being ^paicf to teacher 

• 7 

accountability than to student ccmpetency r I f the nurber of programs is any 
indication. The SEA has developed accountabi I i ty^ programs for v both entering 
te'achers and employed teachers, and the State^ 1 s' Per sonnel Evaluation System 

(PES) includes everyjne employed by pUblic education from the classroom-teacher 

., • a 
to the SEA staff merrfcer. Following are the certification, evaluation, and 

inservice programs currently in effect: 

National Teacher's Examination : By law, anyone wishing .to be certified to 

teach in Loui siana pUb I ic schools must present a satisfactory score'on the NTE. 

The ' accepted cut-off scerfc was established by the State Super intendent af 
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Education,, and the results of testing so far have caused eontrovers ieV4 
.sever'*! teacher preparation institutions. The graduates of some col I eges are ' 
performing significantly better than , the graduates of some otfiW and there 
.have been charges that the present cut-off scores are discriminatory. The SBW V 
has exposed interest in working with colleges of education to use NTE scores^ - 
in a diagnostic manner but it is difficult to do so a> there are-no state-wide 
standaj-ds for teacher preparation institutions. Many ' graduates',!! d their 
institutions continue to be unhappy, and no resolution has yet surfaced. * 

Teacher Evaluation : In 1977, a twelve-member panel wrote guidelines for 

systems. Evaluation plans had to include: ' 

(a) a Jo,b description for each position, \ ' 

(b) specific tasks required by the job, 

' (c). a specific evaluation procedure evaluating probationary teachers once 
' * !" d tenUred teachers at least, once, every three years, and 

(d) a plan for remediation of t»achers found to be deficient. 

Parishes have all constructed such plans, and these We implemented in ; 
The^hnwdlate effect 6f the. plans has been > force'school bonds' to" document 
their del.iberations„on teacher evaluation, and to give teachers the^ opportunity ' 
to injprove skills. .'««.« 

Professional Improvement Pro^ im (PIP): The Professional Improvement • 
Pr^gran is a five-year plan for se if- improvement. These plans 'are wr it£n by 
the individual teacher and submitted to a local coimittee for approval? Accep-* 
tance of the teacher's pi an may include courseworkSs we'll as the assumption of 
additional, duties not part of Job responsibilities. The progran,. with' its 
salary and retirenent benefit increases, has becohe "very, popular 1 and very 
expensive. . it will cos # t $75 million this year. Those teaihers without . 
approved PIPs may still apply for tuition-waivers .for Q>ntinu ing^EducatioJ 
courses. With the approval of the principal, teachers may retjue^t taition 
money for university courses Jn their fields of specialization (up\to six hours' 
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per semester). These .courses must be In addition to the two days of inservlce 
mandated for every telpher, by Louisiana law. V * 

Personnel Evaluatldn system (PES): The PES Is the imbrel la system which 
covers all persons employed by public education. It requires probationary 
teachers to be 4 evaluated once a yea^, - tenur ed teachers to- bj& evaluated 

** , ' 

onceevery three years, and SEAstaff to be evaluated once ewy three months. 

Remarks of Symposium Par ttcipants 

Q: Has your use of the NTE resulted In a teacher shortage? 
A: Yes. However, If an applicant comes within 10# of the cut-off score, 
that person may jipply for an € (Emergency) certificate for two years 
and fake the test again. We are also trying to discourage teacher 
retirement, and we are stepping up out-of-state recruitment. 

• * i 
Q:^ How do you encourge LEA participation in all of ; your teacher 
evaluation and inservlce programs? \% participation tied to 
accreditation? ' 
A: No.' We have no t enforcement standards I p .that sense. If we don't 
approve of a school sgiiffn, we don't'glve then the money to do the 

rngs they want to do. It would be politically crazy not to be 
able to. accept the money the state offers, and school systems are' 
not going to put themselves In that position. 

Our programs and legal mandates In Louisiana are all relatively new. Wb don't 

know vtfiat .the I oog-t^m effects of any of them wl I I be. 
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MISSISSIPPI t o Dr. Alan Evans 

Assistant Director, Division of Instruction 
Mississippi Departnent of EdJcation^ ' 

* CCMPETOCY AND AQ3XNTABI LITY — THE FOCUS CF THE ACCREDITATION AND 

EVALLATltN PRgCESS 

• . ■ X . * 

After a slow start, during \*h ich responsibility for educational account- 
ability *as moved fran one SEA de^frtment ~t\ another ,. Ml ssi ssippi has moved 

v * 

forward quickly to address student competency and accountabil i ty through 
accreditation and evaluation procedures.. In doling so, the Mississippi SEA has 
attempted to delineate its obligations *s we I 1 as the obligations of^LEAs 
concerning student competencies, and accountability. Simll arly, 6 in its approach 
to teacher certification, Mississippi has begun to outline procedures \*hich 
will, indicate the responsibilities of the state department and of higher 
education. 



Student Competency and Accountabil 1 ty ' * • 

In 1975, the Mississippi State Legislature passed Chapter 310, House Bill 

No. 35 Into law. It is "an ac^-to (establ i sh a system of educational account- 

/ 

ability and assessment of edUcationak performance to assist in the rneasur enent 
of educational quality and to provide\in format Ion to school officials and 
citizens." The law clearly Indicates'the responsibilities of the state depart- 
ment of-educatlon and the local school di ktr tetaknd makes I t^essehtial >that the 
SEA apd the LEA work together. Guidelines are briefly and understandably 
wMften, and are quoted below in full. 
.Section I • 

(1) Tb« Legislature hereby declares thai the purpos* of this act is to 
Initiate and^maVjntaln \ state program of educational accountability and assess- 
ment of performance by the State Department of Education *hich will obtain and' 
provide meaningful information to the citizens about the pdbjic elementary and 
secondary education schools, In this state. This information about educational' 
goals adopted by the departnent to student achievement in arfcas of the school 
curriculum, and to Inves't ig*tion of meaningful relationships ' within this 
performance. 
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(2) The Leg! siature further declares that pdblic school districts shai i 
participate in the state accountability and assessment program and adopt com- 
patible district pl.ans in order jo achieve Improved educational accoun tab f i i ty 
>s^/ and to report meaningful information and results to the public'. 

Section 2. k 

t , * N jM The State Department of Education shai i develop a state account- 

ability and assessment program vwh ich will: * 
y ( a ) Establish a procedure for the continuing examination and 

updating of adopted state goals for elementary and secondary 
education. ' . 

(•) identify goai-reiated per formance oBject ive* that wili lead 
toward achieving seated goaLs. 

(c) Establish procedures fqr evaluating the state's- and school' j 
„ district's performaoce in relation to stated goals and objectives. 
Appropriate instruments to measure and^valuate progress shall be x 
A ujed to evaiuate student performance. % 

* . ( 2 ) The stated program shai I provide for an annual j-eview v^) ich shai i 

\ inciude assessing the performance of students in at least the public elementary 

% and secondary schodis in such areas of knowledge, skills, attitudes and under- 
standings, and other characteristics or variables thart will aid in identifying 
r eiationships., and~<M fferentiais^ in the ievei of educational perfomiance that 
may. exist* between schools and 'school districts in the state/' 



(4) The State Department of 'Educatibn shai i ; 

(a) Promulgate rules for the impl onentation of this section. . *\ 

(b) Eijter into such contracts as may b$ necessary to carry^out 
its*duties and responsibilities under this section. 

' /(c) Establish recommendations for -components of school district 
accountability programs and pr ovide^technical assi stance to school 
districts in. planning and, impl emen ting their plans. 
0 -(d). Provide Vn-servjce training for personnel who wi I I be involved 

in carrying put the stated program of Educational accountability and 
assessments perfomiance, • - k- ^ 

(e) Monitor per iodic al ijyL the assessment and evaluation of programs 
implemented by schooi di str iets,and make, r econrmerttla^ ions for thrfir 
improvement and increased effectiveness.^ ^ 

-(f) Annually report and make reconmendat ions to. the Gove/nor and 
Legislature, the State Board of Education, .school boards, and the 
general pii>iic> on its findings with regard to the performance of the 
state elementary and secondary educat ion- schooi system. 

(4) The State Depar tment of Education may establish a state, advisory com- 
mittee on educational accountability to make recormendat ions and assist it in 
carrying out its responsibilities under this section. 

Section 3. : v 

The schooh board of every di str ict in this state shai I : 

(a) Adopt a pian <pr a loc^ acbuntab ii i ty program designed to 
rr^asure the adequacy and efficiency of educational programs offered 
by the schooi district in accordance with recormendat ions amd criteria 
promulgated by the State Department of Education. The school board 
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may appoint a broadly constituted citizen advisory account ' ' v 
, cormittee to make recommendations to the board relative to 
the program of educational accourrtabll I ty, but It shall be 
the sole responsibility of the district school board to 
Implement pi air^requl red, under this section. 

- (b) Report per iodical ly, to the residents of the school ^ 
districts and the State. Department of Education, in such 
v form and giving such information as'the State Department of 
'Education requires, on the, extent to] wh ic t h \ he School di>trlpt 
has achieved the goals and object Ives of its adopted plans. 
> 

. Sect Ion 4. s ' • / 

This act shal I .take effect and be in force frcm and after its passage. 

The issue' raised -is, "For tfiat ar* we Accountable in education?" 'and once 

addressed, the SEA should then be able to 4e'st student learning at each grade 

tevel . ftjt how does one match the standards, the currlculiny and the tests? • 

Mississippi ts trying to nuke the match through its procedure for accred- 

i tation *f. schools, Aim for Excellence (AIM). Encouraged by SEA staff, school 

districts mjjst ask themselves the following questions. 
* * * - , *' A 

• Vihat do'we expect of our students? 

* »■ 

• What .program will help students meet thos* expectations? 

^ • How can we measure student achievement in light of our expectations 
and our program? 

In short, the district and ^each of its schools Ts asked to demonstrate an 
Instructional management system in place. 

Districts, schools, and school boards recede specific guidelines frcm the 
SEA through regional and state workshops wh Ich help each district- and school 
define i.ts Instructional management system. * The Increasing enphasl s dn 
^assisting UEAs with acceptation has motivated the SEA to move fron giving 
local support through subje.ct specialists to giving support through accredi- 
tation specialists. Increasingly, SEA expert! se focuses less on course content- 
and more with the unification of goals, programs, and testing in district-divide 
and schooled© plans. An Indication of *the ser lousness of this endeavor may 



be seen in the Evaluation Program of AIM* The following criteria describe the 
parameters to be applied to the development of an "Evaluation Pr^ram" of the 
AM system 

1.0 All Instructional program areas must include a systematic evaluative 
pr ocess. , v 

2.0 A "systematic" testing process must be developed vthich contains the 
fol lowing aspects: 

2.1 Evaluation techniques, items, processes, etc., must be developed 
i by more than one individual and agreed upon by the instructional group 

implementing the program. 

2.2 The devi sed evaluative process must exhibit characteristics 
associated with quality evaluation such' as: (1) match the evaluation 
items with the program objectives, (2) content validity (measures the 
content of the instructional program), (3) reliability (measures 
consistency over a period of time), etc., (any other characteristics 
which wi I t improve the qual i ty of the measurement devices). 

2.3 *A degree of "control" of the evaluative process must exist *hich 
insures^ }hat all classes of like students be evaluated by 'like 
processes and by similar administrative procedures. ^ / 

,2.4 Systematic testing mist be done periodically in relation to 
program object ives. The nintoer of testing encounters to be determined 
• -."*_* by the district according to the programs being developed. 

3«0. Co Meet ion ind^ut it ization of instructional data: 

. 3. 1 Specific data must be collected vtoich relate student perfotmance 
to program objectives at the program, school, and district levels. 

3.2 Data arc to be collected and analyzed systematically by grade' 
level and/or subject area, by scfiool, and by district. 

3.3 A written plan for utilizing the evaluation data cot lected at the 
building and district level must exist. x 

3.4 A. process must be evident which demonstrates the management of 
the instructional system for bringing about program change based upon 
results of the analysis of the evaluation data. 

The entire acccedi tat Ion process emphasl zes local , regional , fend state 

i 

involvement with student competency and accountability issues, and it assumes 
that a thorough accreditation process will improve student achievement most 
dramatical ly because 1 1 wi I I change uhat happens at the school level. 
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Remarks of Symposium Participants 

• * 
Q: Wiat Incentive does the district and the school have to 

participate in the accrecfl tat Ion process — money? 
A: N>, accreditation is not tied to money. It Is tied to 

the privilege eff athletic program participation. 

Teacher Competency and Accountability 

Work In teacher competency and accountability has not progressed to the 
detail of the student plan. Currently, only teacher certification is addresed. 
After a year's validation study to determine cut-off scores, Mississippi now 
employs the NTE as the determiner of teacher certification. 

The SEA also requires each institufe of higher education to specify 
criteria for completion of teacher trfci^ng and to submit that criteria to the 
state. In addition, the deans of colleges of education must certify each of 
^thelr graduates in twenty-three generic competencies. Further, consideration 
1$ being gjven to fuming a law which will determine entrance requirements to 
•any Mississippi college of education. 
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>EW NEX100 Dr. Ton Chastain 

Evaluation Coordinator * 
New Mexico Department of Education 

COMPETENCY AND ACCOUNTABILITY — A BASIS FOR DECISION-MAKING 



At the present time, New Mexico has no legal mandate for conpetency 
testing or accountability, although the SEA does conduct a state-wide student 
proficiency assessment. Some discussion has taken place in the Legislature 
regarding teacher conpetency testing, and during the 1980 session, the New 
Mexico Legislature provided special funding for a one-year study of the issues 

surrounding staff and school accountability. That study is now being 

J 

completed/ and recorrmendat ions to the New Mexico State Board of Education, the 
Legislature, and the local boards of education are to be made. An interim 
report, detailing conpetency and accountability issues in New Mexico, has been 
widely distributed across the state, and will serve as a catalyst for further 
•discussion as the study is conpleted. 

Student ^Competency and Accountability 

In 1977, the New Mexico State Department of Education established guide- 
lines ior Basic Skills learning across the state, and it required each school 
district to write specific curriculun plans which fit these guidelines. 
Because al I districts must ccmpl y wi th the New Mexico Basic Ski I Is pi an, there 
is also a requirement that "the Department of Educat ion. . .conduct a stater-wide 
prof ic iency examination in order to determine student el igibi I i ty for a ♦ New 
Mexico high school diploma endorsement [underlining added]." 1 Two 
instruments are used, requiting proficiency to.be demonstrated on both the 
Adult Performance Level Test (APL) and the Student Uniting Skills Appraisal. 

/ 

Students graduating in 1981 wi I I be the f irs ^recipients of the 
diploma endorsement based oh their" prof iciency exam results, 
whil e the Class of 1982 wi I I be the first graduating class to have 
the Writing Skills Appraisal affect the endorsement. Neither the 
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fligh School Proficiency Exam nor the Student Wr 1 ting Ski I Is 
Appraisal, as segments 0 f the requirement for the New Mexico 
high school diplcma endorsement, eliminate the EducationaJ 
Standards for New Mexico Schools o r local district require- 
ments for a New Mexico high school diplcma. 2 

The tests, are given for the first time at the tenth grade level, and if a 

student falls to demonstrate proficiency on either or both, remedial instruc- 

tion must be provided and the opportunity, to take the test(s) again must be 

given. Suggestions have been made that the use of the differential diploma 

will be debated in court, but as of this writing, no actual litigation has been 

initiated. 

The student assessment associ ated wi th the Basic Skiljs plan supplenents 
the long-standing New Mexico Standardized Testing Program (1970)'. The Prograri, 
as it currently exists, assesses the achievement of fifth, eighth, and eleventh 
grade students in New Mexico's public schools using the Comprehensive Tests of 
Basic Ski I Is/Forms. Another testing progran, the Vocational Evaluation 
Program, is also used to determine how welt students perfonn in various voca- 
tional skM I areas. During the current school year, 1980-81 , a moratoriun on 
the program is ,in effect while new test items ar% being developed and field— 
"tested to' meet changing vocational education curViculum needs. 3 

Teacher Competency and Accountability 

'i- 

Dr. (Sustain did not -discuss 'teacher competencies and accountabi i ty, but 
he did provide symposium participants with copies, of AgcountabjJ I ty in New 
Mexico Schools : An Inter im Report , prepared by Dr. Agnes E. Toward, Director 
of the Accountability Study for the New Mexico State Department of Education. 
The Inter Im Report is part of a response to' House Bill 2, 1980 session, which 
appropriated finds "to the State Department of Education for the purpose of 
Conducting an accountability study of student performance as a factor in school 
accountability, and the inclusion of student progress in the evaluation of 

I 
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local school district certified personnel." Several i ssue s were 'identi f ied for 

study, and the Inter im Report includes an analysis of these: 

(I) the relationship of student progress to the evaluation of a local 
school district certified personnel; 

(2) the use of teacher competency testing as part of hiring practices; 

* (3) the concept of incentive/merit pay for teachers; and ^ v . 

(4) the usfe of st udenT^per formance data in the school accr edi tat ion 
process. * 

Additionally, sirrmaries may be found of measurement and analysis considera- 
tions of accountability studies, legal aspects of accountability, school and 

p'rogran accountability, certification and accreditation, and the work of the 

* * 

Accountability Study Task Force. Readers Interested in the current status of 
accoun tabi i ty in the state can contact the Evaluating, Assessment, and Testing 
Uhft of the New Mexico State Department of Education. 



New, Mexico References 

I . Dr . Agnes E. Toward, Accountabl I i ty In New Mexico School s : An Interim 
Report , Sairta Fe: New Mexico Staj^e Department/of Education, December 1980, 
Appendix C, p. C-2. 

2. Ibid . 

3. Ibid , p. C-3. 1 

4. Ibid , Executive Sunrmary, p. i. * 
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CKLACM\ o Mr. Howard Potts, Assistant Administrator 

Planning, Research and Evaluation Section 
a Oklahoma State Department of Education 

AOdXNTABILITY, TEAQHER EVALUATION, CEMPETENCY, /WD STAFF DEVELOPMENT 



The Oklahoma State Department' of Education designed,* implemented, and 
conducted an Accountabil ity Program dur !ng the mid-1 970s . The lack of legisla- 
tive funding support, -general acceptance, and Oil I coooperation on the part of 
the LEAs resulted in retraction of the mandated accountability procedure 
approximately four years after initial implementation began. Presently, there 
is no legislative mandate for a student accountability or mintnim competency 
system. A teacher evaluation b 1*1 1 vwts passed in 1977. A rather comprehensive 
bjl I (H.B. 1706) relating to teacher training, teacher minhium competencies, 
licensing and certification, staff development and other issues was passed in 
1980. . 

Accountabi I ity — The Okl ahoma P I an " \ j 

In 1973, the Oklahoma legislature passed an Accountability measure (House 
Concurrent Resolution 1027) requesting that the Oklahoma State Department of 
Education provide regulations within its accreditation process for the imple- 
mentation of an educational accountability program. The resolution further 
directed: # 

• that each school district conduct a systonwide needs assessment; that 
the needs assessment involve focal patrons as we 1 1 as school staff 
members and encompass all curriculum areas at each grade level; 
. • that the needs assessment be under tajtfn by the local school staff in 



compliance with general direcM^n and guidelines developed by the State 
Department of Education! ^ 
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• that a systmis analysis process including goals and objectives be 
utilized to plan the instructional prog/anTto meet identified student 

* nejxls; 

• that an evaluation bre designed and conducted annually to determine to 
tphat extent objectives are being met; >nd 

• that the SEA hold inservice training sessions for adnini stratof s , local • 
school fstaff, and others to effect changes~Tn the accreditation 
process. 

The measure focused on local district responsibility and action and did 
no^ mandate state-wide testing* * * 

No funds were appropriated to support the work on the LEAs or .the role of 
the SEA in assisting the local districts. Most districts approached the task 
professionally, although reluctantly, and worked rather hard on it. tony of 
these districts have continued positive aspects of the process.^ Same 
district's,, however, did not take the accountab i I i ty measur e seriously and made 
minimal efforts to comply with it. Lack of funding, lack of understanding of 
^-the prpfcess and potential benefits, resistance to change, and general non- 
acceptance of a process viewed as imposed uffcn the local districts combined 
resul ted in di scontinuat ion of the accountab i i ty process requi renent for 
accreditation purposes in 1977. 

Teacher Competency and Staff Development 

1977 saw the passaged a teacher evaluation bill written for teachers and 
adninistrators. It requires that teachers be given written regulations pur- 
suant tp their job responsibilities, and mandates that non-tenured teachers be 

ft s 

evaluated once every three years. Additionally, it Informs both school 
district and school personnel of-due • process in the event of def ic ienc ie's or 
* disputes. , * 
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This evaluation bill has been supplemented by a detai?e^bi I I .Enrol led 
House BIN Kb. 1706 of the* 1980- session, which covers staff development, 
teacher certification^ entrance requirements for colleges of education, and 
support for entry-year teachers.^ Scheduled for canplete impl enLtation in 
1982, this Act clearly puts the emphasis on the kind of. support wj(ich student 
teachers,. entry-level teachers, and experienced teachers need to do a good job. 
Following are some examples. . •— — '■ 

'"service: The State will allocate funds to each school district "for the 
exclusive purpose of inservice teacher education staff devel'opment." The State 
Board of Educat ion mus t approve each local' school district's inservice plan, 
-and the plan must conform to guidelines set forth by the Professional Standards 
Board. This section went into effect in the 1980-81 school year . ' 

The staff development plan must be based on recormendat ions of a staff 
development committee appointed by the local school board. The ccrnmi ttee must 
include classroom teachers (.the majority), administrators, and parents of the 
lotal school district, and the committee should consult. with higher education 
instructors. • 

Teacher' Ce rtification : "The Department, with recanmendat ions' %f the 

Professional Standards Board, shall develop curriculum examinations in. the 

various subject areas and grade levels for purposes of ensur ing * academic" 

i 

achievement of each licensed teacher in the area such teacher is. certified to 
teach, as prescribed by the Board." Teacher candidates will be e'ligibl^to 
take the exam following the junior year or the completion of ninety college 
credit hours, and they wil#not be eligible for licensing until having passed 
the curriculum examination. The first curriculum examinations will be given by 
February 1, 1982, /nd thereafter at least two times per calendar year. Advi- 
sory Corfnl ttees in each curriculum area are setting objectives for the exams 
and the National Evaluation/ Services Corporation is creating the exams. 
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The Act docs not specify *ho determines the'' val idi ty of the, exams, but 
they are scheduled to be* Rested in Decanter* 

Responsibilities of Higher Education :* The Department of Education and the 
Professional Standards Board are required to wrk <with a designated authority 
from the Oklahoma State System of Higher Education on a plan to "strengthen the 
screening requirements of college student applicants for amission into jt.he 
education colleges of the scfiools of higher education" (effective July 1, 

The jftate Board of Education ^l so requi res^the successful teacher 




candidate to ""'provide evidence of having worked with children or youth* in a 
variety of * s ftuat ions" and to show significant fleldwrk In accredited schools 

under the supervision -of higher education instructors (effective July 1, 

/ * • 

1981). . 

The State Board must wrfc wittrthe State Regents for Higher Education to 
establish teacher education programs for teacher, education faculty. The 
programs must be approved by teacher education" faculty committees! one member 
of whidtfmust be a pub I Ic school classroom teacher. \ Programs must require all 
full-time education faculty member's! including the Dean, to serve in a state 

• * • * , v v ' : • 1 

accredited public school the equival ent f of a"^ I east* xone-hal f day per week for 
one semester. A This service must occur ev o ery five years. 

Support* for the Emtry-Year Teacher : By toy 31, 1981*,° the Department will 
; have establ I shed, the Entjry-^fcar Assistance Program. 6 The Progr am wi I L pr ov ide 



entry-year teacher position guidelines to Jocal school districts and mandate 
that each entry-year teacher be afforded Jhe support^ of a teacher consultant, 
an entry-year assistance committee and an appropriate inserv ice-program. The 
teacher xonsulttmt, 9 an experienced .IrtfaStSjer In the school, should provide 

r - * 

personal guidance to the try-yea^ teacher. The entry-year ccmmittee should 
assist the new teacher in all matters concerning ^classroom management and 
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Inservice training. The corm'ttee will also decide Aether to reconmend the 
entry-year teacher to the State Board for cert I flcat Ion. . W certification is 

not reconmended, it must suggest specific mediation. If it is recormended 

P 

it must suggest inservice to strengthen the teacher's teaching skills. 
Remarks of. Symposium Participants • '•" 

Q : pDocS|Okiahoma have reciprocity in certification? a ^ 

A: I Oktaffcma has agreements with some states, 
*( (Nf* MexUo): No reciprocity in our state*. 
A: (Mississippi): No r'eci proci tA in our state. 

A: (Arkansas): No reciprocity injour state, buj wd are try.ing to'ichleve 

i t • 
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TEXAS t N*. Charles Nix ' 

^ ' Associate Cormi ss>ioner , 

f ^ • Planiring and Accreditation 

Texas Education Agency 

COMPETENCY ACCOUNTABILITY.— UHAT ARE THE, FUNDAVENTALS THAT EVERY 

STUDENT NEEDS? 

* 

The^State of Texas is putt i ng together "some* of* the major planksof an 
accountability platform." TJiese planks are based on specific programs and/or 
legal mandates, and include the following: ; 

• tjhe; school accreditation process, 

• an attempt to clarify 'currifcula expectations at various levels, 

• a state-wide testing progr^n, 

• a court order 'in bilingual <^ucat ion ,and 

• • the recently enacted legislation regarding assessment of teacher and , 
administrator competencies* 
* *» " . 

Like the other states in the regioif, Texas is concerned ,wi th determinTng; "the 
knowledge that afl students ought to be acquiring as a result of going through 
school," and is equally concerned that it gets better and better at delineating 
what knowledge and skills teachers and administrators should have before they 
work in oUr schools. Of course, we don't expect to uncover all tjrft answers 
with same bit of magic, but, like you, we hope to continue to* peel away the 
layers of the ,qcyst ions , and' find some guidance in our discoveries. 

Student Competency and Accountabi lity 

Four^ft^ platform planks relate most directly to 

students. They, in addition, have significant implications for^ the Texas Edu-~ 

* m * 

cation Agency (TEA), Regional Service Centers^and local school districts. 

The School Acer edftat ion Process : The-current schoo) accreditation process 
In Texas was instituted 'two years ago. Uhen the new process was developed, It 
marked a significant change in State Board of Education pol icies. -Essential ly, 

s 

th^ State moved from the simple expectation that standards of good practice 
would be maintained, to the application of specific criteria to school" 
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district operations \*hich *puld hold thorn accountable for the educational 
outcdnes the criteria Implied. That 1s, a general sense of good school 
practice gave wy to a specific school management approach advocated by jthe 
Texas Education Agency. That approach is a planning approach, and puts the 

t 

emphasis not so much on vthat teachers and administrators must do, but on wh^t 
students ought to learn. The accreditation standard says that "school dis- 
tricts must set goals for student development, not for good teaching." In 
ordcr t0 set goals for student development, the districts must assess student 
needs, and they must' design- their programs accordingly. Districts must 
continually measure actual student development against student development 

« m 

$oals, and -be pr eparecfv annual I y to improve their prograns. 

The Texas Edition Agency received the clout it needed to enforce this 
approach uhen the State Legislature "passed a law requiring that a school V 
district must be accredited by the Central , Educat ion Agency in Texas in order 
to receive foundation school program funds" (2W to 85% of school district 
funding). There is now a five-year cycle during which schoal districts assess 
needs, establish pr ior ities,T bui Id a district plan, impl,em^t the^plan, 
* evaluate the plan's effects, reassess the needs, priorities, and plan, and make 

* 

appropriate adjustments. ^Annual evaluations assist school districts in deter- 
mining whether -student improvement is occurring. Schools have required a gre*t 
deal of assistance with the new accredi tation mandates, and have received most 
of the technical assistance from the regional service centers. It might be 
added that when Texas began this new process, district planning was emphasized. 
Soon wc discovered that the campus made the difference, and now district plans 
tend to be a ccfhpj I ation of the campus or individual schoolypr ograms 

An Attempt to Clarify Curricula Expectations : A second plank in the * 

accountability platform is the attenpt to clarify curriculum expectations. By 
curriculum expectations, the T.exas Education Agency means those things the 
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students are expected to learn, j^ot the manner in *hich such things should be 
taught. Over the past several years, TEA has attenpted to designate essential 
learning outcomes in reading, mathemat ics, and most recently, written conposi- 
tion. We are trying to determine the fundamental tools which students'must be 
given. Based on our thinking so far, TEA has revised Its cur r icul urn fr aneworks 
(i.e., curriculun guides), attempting to provide leadership while allowing 
local di str icts max-knun authority in their cur r icul uV) d^nTTon s T Though these 
^ curriculum frameworks are not yet regulatory, TEA does s^r ive for a carmon base 
of assunption^ about student achievement across the state. The ' State 
Legislature is currently cons ider i ng a bill "mandat i ng- that the State Board of 
Education define 'the Ikls-Ic or essential or minimum conpetencies -Across a 
well-balanced curriculun." At/ TEA, it is believed Jhat the basics are more 
than language arts and mathematics, and now the State- Leg i si atur e vwmts to 
know, "what then, are the bWiier?\ Let's have. the State specify those things 
which all students ought to have every' possible chance of acquiring through 
formaj schooling." 

State-wide Testing Program : After a sfcnpl e testing across the .state in 

1978 in the areas of reading, mathematics, and waiting, the Legislature passed 

a bill that required TEA to, establish criterion-referenced tests based upon 

essential outcomes *in reading, mathematics and writing. These essential 

outcones are called minhum basic skills conpetencies. The tests must be 

administered to all students in grades three, five, and nine and they are to 

measure not average expectations, but minimum conpe t'enc lies. These are the 

$ 

K 

.minimun competencies virtually all grade-level students would be expected to 

master in reading, mathematics, and writing. Local districts are required to 

« 

use these results to identify students who are not coming up to achievement in 

these basic minimim conpetencies, and to strengthen' instructional prograns to 
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bring those students up. to at least minhnm competence, j State fiiids are 
provided to assist districts in the assessment and the subsequent remediation 
dictated, and the acrcr^ tation process expects these test results to be an 
influenced program planning. In other*words, the testing program ought to be 
part of total district thi-nking. It should be added that the law requires the 
district to repor.t test results to the cormunity, adding another nw^ur^^f 
accountability. As one mighjt: suppose, ' the major challenge, of this testing 
program has been the writing sample test. Students are given a writing 
assignments and astced to conplete It in Jhi English language, demonstrating 
their ability to organize ideas in writing, and to address a specific 'audience. 
It has be*n very difficult to develop scoring criteria for good writing, and 
equally trying to trainband supervise steers so that the.criteria do not shrift 
as the scorers gain experience. ^ 

A Court Order in Bilingual Education : Texas has received a court order 

which specifically requires the qstab 1 1 shnen t of criteria for the measurement 

• * 

of English proficiency on the part of non-native English speakers, and it also 

requires the establ I shnent of measirement , instruments for oral and written 

* 

English lingujge proficiency. There must also be a designation oY^uantitles 
on each, of those ^ instruments that wi I I represent th^ level of English 
proficiency required to f,un<£jjj>fon in an English-based curriculum* 

Remarks of Symposium Participants % j{ 

Q} Could you tell us' more about the scoring of the writing s.OTkle 

A: In both years; we've u$4d a contp^or. The contractors hav^yworked 

with us. to devefop the test, and tljelr scorers have been trained • / 

teachers or English langua£* arts experts. They were specifically 

trained for scoring, and the scoring was done outside of Texas. The 

first year, we 4iad 500,000 student papers, and the second year we had 

700,000 papers. Eich paper was graded by two scorers*' The scorer 

judges the paper as a whole, and also Scores handwriting legibility. 

I don't know how much it costs to score the wr I t ing sampl e , but the 

contract for scoring al I three tests was a little less than $2 million 
this year. ' * 



3 4 



40 



Teacher Competency and Accountability % 

„ The fl f th plank of Texas' accointab 1 1 i ty platform will be based on 
recently enacted legislation regarding assessment of teacher and administrator 
conpetencies. Senate Bill No. 50 of the 1981 session "relates' to the certifi- 
cation of public school teachers, super fntendents, or other administrators and 
to testing requirements as prescribed by the. State Board of Education." The 
State Board now has the authority to establish classes of certificates a<id time 
periods for eaih class of certificate. The intent seems to be to move away 
fron permanent certification to a r edcmonstratlon of skills and/or an updating, 
of skills. Secondly, the State Board has been mandated to set up competency 
tests fop teachers, superintendents, and other administrators. Two sets of 
tests must be developed. The first set of tests Is to be taken by students at 
the end of the sophomore year before entering a university teacher preparation 
program* This set of tests should measure basic literacy in English and 
mathematics. • The second set of tests wi 1 1 be administered, just prior to 
certification and will measure specific pedagogical or adnini strat ive skills 
appropriate to the certificate application. 
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(TMFETErCY AND ACGXNTA8I LITY ISSUES IN THE REGION 

It is clear that each of the six states of this regionJias taken different 

- • * " 4 

approaches toward competency and accountab i I i ty demands. Each state has begun 

with its unique legislative base and long-standing organizations and traditions 

and is trying to find solutions that will fit all' of these. Seme states have 

started an«v; others have tried to bull d on past work; all are struggl ing wi th 

unknowns. To simrurize the status of the region, the following- -charts are 

provided. The conparisons are clear. 



TVE DCMIWNT ISSUES IN THE RBSION 

As the tables. indicate, the issues addressed and the policies and proce- 
dures adopted by the region's states vary considerably. In order to help the , 
participants and * consul tants focus jvn carrron concerns, Mr. Charles Nix, ' 
Associate .Carjji ss ioner of Planning and Accredi tat ion , at TEA, culled' the 

f * * 

competency and accountable i ty» issues suggfrsjed by the representatives' reviews, 
The issues identified are listed below. 

* • In ^at ways are laws and courts concerned wi th the relationships 

among curriculum, instruction, a^es$ment., and resources? 

* • Should we be sfriving for product evidence (test results and measures 

of attainment) or process evidence (effect ive, problen-so| ving) in 
accountability programs? 

• • Who has "ownership* of accountability — state legislatures, SEAs, 

LEAs, parents, students? Is there-central responsibility and 
^peripheral respons ib i II ty /an* how are they distributed? 

♦ • Wiat are reasonable «xpectatibns for students to have of the 

educational s^ten? Are expectations adjusted according to outside 
influences on the individual student? < 



How do you define the basics? How do you decide what the- minimum 
are? Do minfrmuns become max imiJTK in an accountability system? 



• What are the proper uses of accountability conclusions? To find 
*eak spots in the system? To determine stewardship of the educa- 
tional system? To determine certi fication? 
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SIX-STATE REVIEW OF TEACHER COMPETENCY LAWS AND PROCEDURES 





Is there a state 
law? 


Who' is responsible for 
implementing the'policy? 

H 


,How is it Implemented? 


What is the outcome or use? 


Arkansas 


Yes 

<? • * 


Estate Board of Educlf^ltin through 
• the State Department of Education 


The National Teachers Examination is. 
administered to all teacher certifi- 
cation applicants. Cut-off scores 
will be determined by Feb. 1983, 
after which NTE scores become 
decisive. 


The NTE determines teacher certification. 

— t r 


Louisiana 


Yes 


Applicants for certification must 
take the ^atjonal Teacher Exam- 
ination. Parishes must develop^ 

tPArhPr Pvalnatinn -nlarK which 

assure due process. The super- 
intendent sets cut-off score. 


The NTE is taken by all teacher 
certification applicants. Parishes 
had to submit evaluation plans to the 
SEA for approval; implement plans in 
1980. 


NTE determines teacher certification/ 
Evaluation plans specify due process \ 1 
and the opportunity for remediation. 

) 


Mississippi 


Yes 


State Board of Education., State 
Department of Education. 
Institutions of, Higher Education. 

~\ 


The NTE is given to all teacher 
certification applicants. Approves 
criteria set by teacher training 
institutions. Certifies each 
graduate in 23 generic competencies. 


NTE determines teacher certification. 
Influences goals of teacher training 
programs. 


New Mexico 

* 


Yes 

* 


The State Education Department 
conducting bp accountability 
study of student performance as 
a factor in school accountability 
and school personnel evaluation. 


An Accountability task force of SEA 
and LE#>eople are studying issues 
specified by the Legislature, 


Jnterim Report of findings. Recommenda- 
tions will be made to the State 
Legislature at the end of 1981. 


Oklahoma 


Yes 
Effective 
• 1982 


Local Education Agency. State 
Board of Education. State 
Department of Education. 
Oklahoma State System of Higher 
Education 


Plan & conduct teacher inservice. 
Plan & conduct school personnel 
evaluations. 'SEA is developing 
curriculum exams to use for certifi- 

cation, oet btdtcwruc criteria i ur 

admission to colleges of education. 
Assure'continuing education for 
faculty. 


Support entry-level and experienced 
teachers. Certify teachers accord ing> 
to state standards. Assure consistency 
across colleges of education in Oklahoma. 


Texas 


Yes 

3 ' ' 


State Board, of Education 

* 


Will require competency in language 
and mathematics before admission to 
a teacher training program in an 
institution. Will require a test of 
professional skills. Applies to 
teachers, superintendent &'adminis- 
trators. 


The test will be one requirement for 
certification. 

44 

t 

> 



\ 



SIX-STATE REVIEW OF STUOENT COMPETENCY LAWS ANO PROCEDURES 
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Is there a state 
law?" 


Who 1s responsible for 
Implementing the policy? 


How 1s 1t Implemented? / 


What is the outcome or use? ) 


Arkansas 

« 


\ 

Yes 


State Board of Education through 
the Department of Education 


Y 

The law mandates minimum performance 
testing at at least three grade \ 
levels. By 1982, the state depart- \ 
ment will have developed validated 
minimum performance tests which will 
be administered to grades 3, 6, and 
8. 


Scores will be used for diaanostic 
purposes, not promotion or olace- 
s ment' 


Louisiana 


Yes 


State Department of Education 
administers tests; LEAs implement 
remediation. 


the SEA administers tests, grades 
2-12. LEAs design Pupil Progression 
Plans describing test preparation. 


The Test is one factor used 1n deter- 
mining oupil progress. The PPP is 
required for the LEA to receive money. 
The PPP must specify a remediation 
process applicable to all students. 


Mississippi 


Yes 


State Department of Education 
Local Education Agencies 


The SEA conducts a testing program 
1n grades 4, 6, 8. The SEA mandates 
Instructional management systems. 
LEAs create and Implement instruc- 
tional management systems. 


Scores are reported statewide. SEA 

gives technical assistance to LEAs. 

LEAs create a plan connecting goals, 

programs, testing and evaluation 

within their school systems. 
* 


New Mexico 


No. The State Board 
has developed a 
policy 1n response to 
legislative Interest. 


State Board of Education 
Local Education Agencies 

> 

4 


Basic Skills testing begins in 10th 
grade. Retesting may occur If 
remediation is necessary. Standard- 
ized Testing in grades 5, 8f, 11. 
Curritulum plans written. 


Students who pass the Basic Skills 
Test receive the endorsement of the 
SEA on their diplomas; failure to pass 
results' in failure to receive the 
endorsement* though th& diploma is 
still awarded. Diagnostic purposes. 
LEAs^must produce a plan which will 
prepare students for basic skills 
assessment. 


f 

Oklahoma' 


No 






[In 1973, an' Accountabll ity Measure 
putting responsibility for thorough 
curriculum planning on the LEA was 
Implemented but was discontinued in 
1977.] 


Texas 


Yes 


State Department of Education 

0 


Criterion-referenced tests are 
given at grades 3 and 5, and an 
exit-level test Is given 
beginning at grade 9 until the 
sLudent passes or completes vjrade 
12. 


Identification of students who do not ' 
meet minimal competencies. Program 
design for individual compensatory 
education. Report to community on 
status^of basic skills. 
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• Wiat arc the best ways to determine vai idity and rel iabil ity of 
measurement Instruments? 

• Is it possible for the accountability systan to get in the way of 
productivity? 

• How do we encourage cooperation wi th and cormltment to account-* 
ability? Award funds on the basis of accreditation? Encourage 
product management systans in the schools?' Install exanplary 
program using top superintendents, adnfnistrators and teachers? ' 

f 

* • \Mrat is the learner 1 * respons ib il i ty? Is the school respons ible 
for the \4iole child? Should we guarantee student access or student 
success ? . ~ 

• Are we going to dictate everything that ought to go on in schools? 

(* designates an issue of particular' interest to most of the participants) 

-» 

It is interesting to note that' these questions focus on how accoun.tabil ity 
can be ensured rather than on whether or not the state departments should' be 
responsible for attenpting to answer then. Thus, there is an underlying 
agreement that -requir ing competency and accountability on the part of state 
education agencies is appropriate and desirable and that it can be achieved. 

. — . * * 



L 



47 



9 

ERIC 



39 



) 



III. PRESENTATIONS IY THE NATIONAL ADVISORS 

Aided by fk • Nt^s synthesis and by the inforrmtion provided by t^he state 
representatives, the advisors -provided their individual perspectives and* 
expertise on competency and accountability. 



Ms. Elaine Lindhehi 
< Director of, Test Development 

Instructional Objectives Exchange 
Culver City, California - 

* . ASSESSNtNT DRIVES ORRICULLM WD STRICT ION 

> » 

There is an old Chinese curse, "toy you live in interesting t imes ,« t and it 
certainly cones to mind as I listen to all of you., desc r ibe your efforts in 
educational competency and accouatab i I i ty matter s. Though each of* you presents 
a somewhat different accountability sch,eme, you seem to share at least four 
underlying concerns. ^ t [ 

• Policy — Are we establishing a coherent' po llcy? "Wio is establishing 
it? 

* • 

• Lack of money and staff — Are we able to.do what we think best 
under these conditions? * 

• Improvement of student achievement in basic skills —Will these 
accountability efforts truly help students? *> 

• Sense of public and political pressure — Can we satisfy ah inter- 
ested parties and dowhat»s best for the schools at the same Jime? 

Certainly, the situation cal Is for a creative -problan-sojving^ model , and 
perhaps it calls for doing a little thinking a bit removed from the just- 
mentioned concerns, and focused on a specific procedure. /Ymj_wMI find, I 
think, that this procedure will, in the end, address your concerns. I would 
like to ^suggest that you consider an acco^ntabi I i ty model centered on student 
achievement. ' 

The model I propose stems frcm the option each state education agency has 
in performing its functions; that is, the SEA can tje proactfVe or reactive. If 
1 1 I s reactive, i t mainly strives to be in cajipl iance wi th whatever laws, rules 
or regulations come down frcm the Legislature and the State Board of Education. 
If the SEA is proactive, it concerns itself with enhancement. It seeks to 

0 

influence the laws; rules and regulations which it Js given and moves one or 
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two, steps further* * Enhancement also has the attraction of offering the 
possibility to improve the public's impression of education* 

Let's be honest about this. Assessment _[i driving curriculum and 
instruction today. Assessment is wedded to teaching. This is not so horrible, 
because I believe that these assumptions imply significant benefits. 

t"St udents wi 1 1 have improved mastery of skil Is, * 

sT * ■ ■ * 

• Teachers will feel confident's they^ee tang ib I rej ults from 

• their teaching. * d • 

v ,* * ^ 

• Increased interaction wi I I occur among students, teachers, 
administrators, and parents because the goals wilj be clear. 

• Time-on-task within the classroom wi 1 1 increase with specific 
skills to be taught and spec i f ic measur cment of ach fcevement 
expected. ^ V ' -fr— * 

o 

• Students 1 impressions of themselves and the school will improve, 
and so it follows that parents 1 * impress 19ns of student achieve- 
ment and the school will improve. ^ • 

Wiat if w©^ could somehow move awa^ from competency testing, even now? W10, 

•. J * . ;. v - - ,; . ' ' . 

then, wouU be disadvantaged? Lawyers and- test-makers would surely suffer, but 

■j; • 7 ^ J ' 

who else? Stud^its, especially minor i t iVs-and fthe handicapped, would suffer 

y v " ■ < , • W\ ' : 

because they wofildp't^be as, aware of their problems, arid wouldn't be in a. po- 
sition to demamf or expeci 4 a]>propr iate : r cm$cttfct iort. Educa^rs* woi/ld be at a 
disadvantage because they woQld still be feel jng ,pii> lie pr essur e wi thout hav- 
ing a clear organized response. Taxpayers.' would be left withoufr being' able to, 
judge value received. There must be effective testing for stu^rit 'competencies. 

ia^y and: I ogicai? Tern Fisher, 
beleagured Director of Testing In Florida, has 9 said, "The beat defense is to 
have a well desired program in the first, placfe. 0 I would' ilke tp suggest^ to* 



But how? How do we do what sounds so ti\ 



you some specific testing procedures that can influence the so I b$ design of 
your program — I call them Positive Proactive Procedures. ' These are aspects 
Which are crucial in any testing scheme, and will increase the ultimate 
effectiveness of the testing. 
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Critcriofr-ccfcrenced testing . Criterion-referenced testing is to be 

preferred over norm-referertfed testing. Norm-referenced tests, which^rank 

« 

. students against each other, are not appropriate because they give no specific 
information to the individual student. Also, since they are not tied to pro- 
gran goals, they- provide no feedback to educ-ators concerning their programs' 
effectiveness. Criterion-referenced tests, measuring a student's achievement 
against an established standard, in all ways provides greater clarity of de- 
scription. t ' 

Decide the skills to be tested^ Remember that you are designing a system 
wfiich tests attainment, but is secondarily diagnostic. Wioever decides vvhat 
ski I Is are to be tested 'should decide the minimum worthwhile ski I Is. I suggest 
♦ that the decision process ought to include public outreach. Get a .wide ( 
audience involved in designating theminhums — get several perspectives. And 
be sure you are composing a realistic list of skills which can be rrastered in 
the time available; donft make a wi sh list. ^> \ 

*. Write a rigorous explication of the program . Ckarly show the rela- 
t ionships among the skills you 1 ve ident i f i ed , the program you 1 ve devel oped , 

^the testing scheme you will employ. Be sure your writers are people familiar 
with instruction and measurement, and be sure the program as vrcll as the 
testing is closely related to the skills list. 

Create the test . Strive for congruence of test itens with test skills,, 
and don't neglect the need to create different, but equally difficu/t, tc^t 
forms. 

Al l r ow adequate pha$c-1n time . Provide plenty of ^student preparation time 
prior to the first schedul ed testing, and pi an \ for multiple testing 
opportunities. - 

j 

* Set performance standards . Again,, with the widest possible range of 
decision-makers, set the standards you will accept. A group with many 
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perspectives represented will alsa-be able to give advlxe regarding *hat should^ 
happen *hen the standards aren't met. 

Give strong instructional support . Once the skills, the program, and the 
testing are united, support the teachers with appropriate inservice and 

materials. Be as clear as possible in describing uhat you expect the students 

< 

to learn, and how you expect teachers will help them. Point out that a rele-~ 
vant competency-based program is based on appropriate instructional methods. 

" Keep concerned constituencies informed along the way . This ^ nc ^ uc * cs 
students, teachers, administrators, parents, SEA staff, higher education 
faculty, and legislators — don't surprise anyone. 
Leave everything open to revision an(^ review . 

I believe that a testing scheme which includes these aspects wilJ support 
sincere conpetency and accountabil ity ahis. Measurement does drive instruc- 
tion, and i W ean viork for^jfT 

j 



\ 
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Dr. Fred McDonafd , 
Senior Research Psychologist 
Educational Testing Service 
Princeton, New Jersey 

ACCOUNTABILITY DEMANDS PRCBLBrt-SOLVING, BUT DO WE H<WE THE LUXURY OF 

SUFFICIENT TIME? O 

I 'm mostly interested in the relationship between .teacher and student 

accountability, but before I speak of that, I must 'talk about that word, 

h ■ . 

"accountability." I'm well aware that accountabi I i ty is often a code word for- 

* "response to public' pressure," and that makes it hard to keep the issues 

straight and to talk cleardy^bout them. Vtaat are the things people talk about 

\rtien they discuss accountability? They generally refer to one or rrore of the 

following: 

• a preparation system for teachers — that is, a system which 
producesVconpetence (knowledge plus acquired skills)..! SEAs 
here have talked about accrediting teacher preparation insti- " ' 
tutlpns, licensing teachers, setting standards for proper 
teacher preparat Ion; , ' 

4 tv 

• a schopl improvement system — we have heard, about needs assess- 
ments, evaluations, programs tied to testing, and establ i shnent of 
goals; 

•monitoring programs — especallyas dictated by the federal 
* government; and 

• fiscal audi ting. 

The last two I tons -are not part of accountability because accountability 
really refers to solutions to specific problems and implies a troubleshooting 
*model and a theory of cause and effect. If -you have a system or account- 
abiifty, it means noth ! ng I f a 1 1 it doe s is say , n I ook , f el I ows , you at en' t 
doing very well." \r\hat it should rfo is give you two kinds of information: it 
should tell you vtfiere you fail in^j^is system, and if you were significantly* 
below the regression line, it should indicate the kind of corrective action, to 
be taken. You're in school, you are accountable ^for doing something about a 
troubled situation. The students are obviously performing less we I I TfiaiTHhey 
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should perform. But, an analysis is also made of the character fit ics of the 
schools which were doing much better and that information indicates that over 
here^they have this kind of read-ing progran, or they h^ve- that kind of, staff 
organization. The whole purpose of that analysis is to give people information 
'to help them to appraise the si tuition and then cjme up with a correction 
action pl*n. Wiat they were accountable for was acting on knowledge and the 
information that was available to them, and they were accountable for trying to 
do somethi ng about it. It strikes me that vrith any kind of accountab i i ty plan 
you have, there are tho*e two things that need to be done. AY point, there- 
fore, Ls that any accountability system has to be targeted to that kind of 
problem solving. It functions best vOieji it is specific — when you're 
concerned about reading, you're concerned about writing, you're concerned about 
something else and you have real deficiencies. That i s my notion of account- 
'bility. 

Let me show you* how A t can work. 1 Chart I (shown on page4$) shows the 
stages fn learning, and jgiyes you some idea of what is needed to bass through 
these stage*. Perhaps you can look at these stages and determine a^cte-ficiency 
by engaging a student in * task and observing, vdiat happens.. Perhaps, even, you 
can giv-e a paper test, and see that learning has not occurred. But a test is 
only a meter,, and it won't tell you the cause of the problem. You rmrst look 
further to find the cause and plan remediation. 

Chart 1 1 (shown on page-48 ) indicates the major infl uences on learning, and 
the possible sources of learning problems. We can think, for a moment, of the 
teaching infuences. Research has beendone on teaching effectiveness, ^nd it's 
pretty well demonstrated that there are differences in effectiveness anorig 
teachers baled on i nd iv idual di f ferences • The research has, been done , 
i ncidentaMx^JjUjiJe last five o<- six, years. In general , wh^ the ineffective 
teacherWtoes is Repress progress at almost^ every point, whereas the highly 
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effective teacher produces very rapid growth. You know as a learner that you 
\*>rk according to your own level of energy. You approach something much more 
effectively because it seems more interesting; you get invol ved, engaged; you 
do a lot of rehearsal and so on, especially with guidance of a highly effective ^ 
teacher. Studies of non-effective and effective teaching have pretty clearly 

• demonstrated what kind of teaching skills are related to these differences, so 

f 

it seems to me straightforward to say you should have a preparation system, the 
function of which is ttf guarantee that people can teach what they know If they 
have skills. The issue of teacher conpetency strikes me as something 
straightforward and uncompi icated, but I t's not an accountabil ity system 
because it's just for preparing people to do this particular job. Measir Ing a 
teacher's performance skills is something that none of us have done except on " 
an exper inental basis. We can &lve a conpetency test on knowledge but we won't 
measure the kinds of variables that will make a difference to performance, and 
those are the things \Oiich are related to learning. 

In order to build an accountability system at thfte present t ime , there for e, 

\* 

it seems to me that one has to do it locally. You -can prescribe at the state 

9 

level that it must be a local problem solving, troubleshooting type of system.* 

You can say that it has to get at the spec I flc causes of problems, some of 

© 

which are lodated in per formance^and in teaching, and some of which are located 
I n the schooj • 

It davwed on me that we are now mounting a new system. Two things are 
happening. Qie is that we have.no experience in any of these systems. We have 
never set min imun standards before, and vt have never built this kind of 
accountability system and used to it. Since this Is all new, I prefer to go 
somewhat slower rather than faster , aaA|l 'm getting really uneasy about the 

i 

pace at wh !ch we're going. The other thing is that these systems a°re not going 

to produce rapid change, and no matter \Oiat you do, they will be basically — 
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gross systems. If you work with the teacher preparation, system, it wi II take* 
two decades to get enough teachers In'to. teaching to get any kind of an impact. 
But the state assessment system is not usual ly. bui 1 1 to* produce Iqng-term 
Impact, so putting such a system in isn ! t going to have any impact unless 
people get stirred gp. Every now and then, people wi I l-^Je* aware of the state 
assessment 'system, and then they 1 II forge r t about it vtfien something else pops 
up. The Pope will get shot and we 1 II forget all about state-wide testing. The 
system itself * s nfot going to make our future,- so if you're going to produce 
chinge, you better find a system that gets at causes of problems, that gets at 
them efficiently, and gets them out quickly. And good luck — because we've 
discovered that the basic unit of time in affecting educational change is five 
y£ar c s. 
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Dr. Diana Pul lin 
Center for Law and Education, Inc. 
Cambr idge, Massachusetts 

— ^ ACCOUNTABILITY TESTING — BE'MAftE AND BEWARE 

♦ ■ 
Despite the attonpt to separate'th* issues here, I have great difficulty 

in separating the educational frcm the legal aspect* of some of the kinds of 

accountab il i ty programs the states have descr ibed, arid it is' probably not 

productive in most instances to do so. Increasingly, the imposition of legal 

mandates either by statute, by regulation, by State Board, or by a court of law 

demand of the educational profession things which the professional is not 

C t 

capable of delivering at this time. In many instances, educators have been 
asked or demanded to do something that they are not, in fact, able to deliver 
in a way that they are comfortable with. I would like to emphasize as a Way of 
warning you about my topic, ,that education i s my first level of interest. Law 
is a means to an end, as far as Mm concerned, and it would be almost impos- 
sible to keep me from talking about education anyway. As a word of warning, I 
would say that you may wish to take what I say with consideration of, what 
Commissioner Turlington said vthen the successful appeal concerning himself and 
the Debra. £./Case was concluded. After we won the- case on, the appe'al , 
Commissioner Turlington called a press conference and declared that those af us 
who had raised questions about the competency testing program were un-American. 

It is important in considering all of the types of accountability programs 
we have discussed to real i z e that there is a demand for increased educational 

standards,' and that demand is very real and very important. But I would ask 

* 

you to consider whether the accountability programs we discussed are,* in fact, 
progams which are so designed that we will improve or increase educational 
standards. The public is in ne,ed of educational accountability, but -we must, 
consider vthether these are, in fact, educational accountability efforts; 
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whether they are designed to be accountability efforts, whether they will have 
that result; or whether, instead, some of then will result in a consumer fraud, 

I.e., the picture of an educational system that is not entirely accurals, and 

which in the long run will provoke more public opposition than the educational 
system presently faces. 

Secondly, those who question minimum* competency programs, and other 
accouotabil i ty programs involving testing are indiv idual s, vOio are not against 
testing £tr st. They are people who feel that educational testing Is a very 
'important function, and *ho ask whether the particular test that is being used 
is a quality test. Those of you who work under either existing or coming 
mandates for educational accountability should be aware or beware of the impli- 
cations of the demands being made on you. ,1 am going to talk mostly about 
minimum competency testing because that is what I have thought the most about. 
But I think some of the lessons to be learned from the minimum competency 

testing movement will affect all the kinds of , accoun tab i 1 i ty e'/forts we have 

\ 

* V 

been descr ibing. ^ 

Primarily, all of those efforts involve attempts at a political interven- 
tion rather than attempts at educational innovations. I see these account- 
ability efforts as being a result of very significant and sdbstantial political 
pressures rather than the result of an. en I ightenment within the educational 
profession wh ich attempt s to appl y new I earning to educational pr act ices. 
Despite the fact that these, accountabil i ty efforts are all basically political/ 

innovations, they have very real educational impacts, and those educational 
» 

impacts alt6r the* educational system in tills country in several ways* 
* * / 

First, we are in the process of redefining vtfiat we mean whpn we *de s ignate 

someone as an "educated" individual. We are redefining the outcomes of our 

system of elementary, secondary, and teacher education. The definition is 

being changed as the objectives for the accountability programs are outlined. 



52 



We also, howeveY, are redefining or reassessing our demands about quality of 
educational services being ^provided. ■ Although the demands for increased 
.quality are being ma^e, there is a real problem, regarding whether JJje standards 
being Implemented are, in fact, increasing standards. Elaine Li ndhe im referred 
to the problcn* earl ier • The question is not only whether the test measures 
against a standard vriiich is a new higher standard but also whether the test is 
c oqs i stent over t ime . 'Several of the corfpe tency test ing progt ans I have 
examined, for example, are touted as being programs in which increased student 
performance 'on the mi n rnim competency test is described as proof that the 
educat ional system is both worki ng and provoking real educational improvemen t 
among students. The same educational testing efforts, however, use test 
instrunents which have never been validated. There is no proof that the tests 
ire not getting easier and easier, and therefore, there is no proof that the 
students are learning more than they have -in the past. I suggest caution 
before implying that a particular system is functioning more efficiently, when, 
in fact, it could be v underminfng the, pursuit of accountability because of the 
nature of the test instruments used. This may be the inevitable result of the 
political motives of those who propose marfy types of accountability efforts, 
although any measured improvement 7 in educational achievement relieves some of. 
the political pressure which motivated the implementation of the program in the 

4 

first place. 

The other aspect to the change in the de f in i tion of educat ion which 
results from these programs at the el enen tary/ secondary level is that the 
programs are, in fact, narrowing the curriculun being offered in the schools. 
The "minimums" defined through competency t6sts or by the educational objec- 
tives are becoming the "maximum" due to the intense pressure on st udtr^s and 

on teachers to perform successfully whatever the assessment standard is to bc*r 
This narrowing of the curriculun, which is^a result of accountability efforts, 




cones at a time when there is Increasing evidence that It Is not basic skills 
achievement which Is declining. It is, instead achievement in the more conplex 
skills — conplex skills which are not assessed in most conpetency testing 
programs. ^ 

Another very signi-ftrknt educational , impact of accountability efforts is 
to have the result, If not 'the intention, of transferring control of education 
ffon 'the local, school district or 'the teacher preparation institution to the 
state. The control over those programs b,y the state is potentially alluring to 
the federal ftvel . The state is not dictating curriculum in those-slates where 
there is a state competency testing program. It' is not outside the realm of 
possibility that the .federal government will begin to dictate to the state 
direcHy. .Many of "the block-grant proposals we discuss in Washington now 
include a federal requirement for needs assessment or ameasire- of account- 
ability. The second manner Jn which control of education Is being challenged 
involves a shift \Oiich has been occurring for some time. Decision makers at 
the local Uvei are changing fron ^parents or schoolboard members to educators. 

s 

^ Finally, i think the impact of the accountability efforts we have dis- 
cussed, and the impact which is of most importance to the' legal system, is the % 
shift of responsibility for the success of educational system fron those >Oio 
are providing the services t.o those who are receiving the services. It is'very 
clear that the extent of the controversy over {ht use^of minhum conpetency 
testing is as great as it is because of the extent of the harm on students who 
ar % denl?d dl P ,0TUS and other rewards of the educational system. Let's look 
then, at the scrutiny of these kinds of accouriub i I i ty efforts by the, courts, 
and let me try to project for you vtoere I see all of this going in the near 
future • 

First, you are fairly unique as a region^tf^the country becaujse \ou have 
avoided many of the problems inherent in these types of accountability efforts. 

; i. ' . -> 
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As I look across the country I see the u$e> for example, o f m\ n hum competency 
testing to: ^ y 

• differentiate the diplcmas awarded — the case In New Mexico; 
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• deny diplomas altogether; 
^ • deteimine class placement; 

• determine grade promotion; or to 

• determine initial entrance into the school system, as was the 
case in South Carolina. 

Each of these efforts holds students accountable to-a different extent, but 
each of the efforts places- upon a ifucjent a'major re^opsib i I i ty iot, the sue-* 
otsi of the educational system. The chances of legal scrutiny of the program 
increases substantially when the student is to be held acceptable or respon- 
sible for the succes^of the educational system — responsible in .such a way 
that there are no provisions for weighing anything other than the student's own 
effort in making the' determination whether education has been successful. We 
do not know the extent to uhich home * env irorment, status, motivation, or effort 
contributes to the success of the educational process. There is np one who 
suggests that the student is the only variable In the^educ£ji*)i equation. Let 
me br i e f 4 y describe the occasions upon vtfiich conditions of the accountability 
programs have triggered court scrutiny. 

To date, there is a handful of lawsuits pending aaalnst various states and 
local school, districts on the use of competency /testing to make various 
determinations about students. Only two of these cases have been decided. The 
first decision was in Debra P . vs . Tur I ington , a court and district court case 
in which I Was involved, and in. which the court determined that it would be 
appropriate to place a four-year moratorium on the use of functional literacy 
tests used to determine the award of high school diplomas. That district court 
decision was based upon two theories. The first t halt many of the students 
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tested as part of the di-plana requirement were blac k st udents who had 'been 
denied equaf edueat lonal opportunities in the past. There had been sufficient 
evidence of a relationship between segregation and test performance, but there 
*as a substantial disproportionate .failure of blacks. The students' earlier 
educational careers »had been in segregated schools, and so it was not 
appropriate to use the testing programs for those stude^tsT Secondly, the 
district court was concerned about the phase-in time for implementation and 
^time afforded for preparation. The court basically held that there 'is a 
requirement under the Constitution of this country that students and teachers 
be giv*n an adequate opportunity to prepare to pass an examination when that 
examination is used to determine the award of ^ diplona. 

Our appfal of the cas* was based on the grounds that the court had not 
^sufficiently understood the importance of this need for notice of phase-in and 
that if there was a Constitutional requirement of notice of phise-in time, that 
requirement was more substantial than the district court had described. There' 
had to be not only phase-in time, but proaf that during the phase-in time, 
_ there were efforts being made tjo ensure that the students did, in fact,- have an 
^^opportunity to learn what wis o n the test, and\^re being subjected to a test 
that matched \*hat they had been taught. The appeaPwas successfully concluded 
on behalf of the students. I suspect, however, thafc the rratter 'won't end 
there, but I do not see a strong likelihood that the Vupr mt Cour nri-/l be 
interested- In going all the way ftv cons ideV ing * issues "of* general testing 
techniques. I am not sure this is the issue they would be particularly inter- 
ested in, and they have the right to decline to consider it. 

* * 

The decisionals not one *hich leans heavMy on legal precedent, ft is a 

*.u ♦ « 

decision which is based upon, a fairly intuitive conclusion on t<he part N of the 

* % ' 
-Cburt that when you propose a legal mandate of the type imposed, there are 

certain camion sense principles which must apply because those principles are 



rooted in the due process and protection clauses of the Constitution. Bri'efiy 
sunrmar i zi ng, the Court said that it is very important and very attractive to 
increase educational standards. Quality of educat ion must be improved, and the 
Court recognized, as has every other court to consider this issue, thart efforts 
to improve educational quality are desirable and that they should be encour- 

aged. Wiat the Court said, however, U that you have an educational system 

t 

which the students enter with a reasonable expectation that if they progress 
successfully through school attending on a regular basis, passing their 
courses, and getting good grades, that the successful passage through the 
program will result in a diploma. It is unfair to haVe-^successf ul I y gorre 
through the system with the presumption tht you were being educated and then be 
told at the eleventh hour and the twelfth hour that while you thought you were 

I 

being successfully educated, we have ascertained that we have a new measure 

* • 
that indicates that you were ,not. I spoke to many of .my clients who said to 

me, n Wiat can I do? I went to school regularly. I got A 1 s and B's. v In fact, 

I was on the honor roll. 1 did everything I possibly could do. All of a 

sudden I was given thi s ^test wti teff they told me indicated that I had not been 

successful. 11 , The Court recognized that the * expectat ion on the part of the 

student regarding the suc^e^sful passage through the system was legitimate 

reasonble and constitutionally protected. There were certain standards to 

which the st^te would be held in. attempt ing to deny that reasonaSlfe expectation 

to the students. ^ 

The Court recognized thit there is some fundamental principle of fairness 

involved* in such testing progr ams. , ^ The principle requires that when one is 

going to use a high schooj test as 'proof that the student "ffas successfully 

passed through the educational system, it must be established that that 

examination covers materials tfi^t the student has been taught in the schools. 

The court used the, terminology we have been suggesting for a long time:' that 



in curricular guides, the state using a test to deny high school dipl anas must 
establish that the things used in the test are "currentl y taught in school, that 
* they have been taught in the past, and the students have had a fair opportunity 
.to learn. In the oral argunent to the appeals court, Florida could not prove 
those points. There certainly was not a sufficient mount of proof being 
offereti as to the match between testing and teaching, and, in fact, the state 
comiission handling the study of the testing progran had concluded that the 
Information covered on the test may have been taught to seme students but nay 
not have been taught at a 1 1 ^ I like the'inalogy the Court made in discussing 
the whole process of education. The Court points out that jusras a teacher in 
a particuUr classroon would give the final examination only*onwhat he or she 
taught in that classroom, a school should give a final examination only on the 
conpletion of twelve years of study on vtfiat had actually been taught during 
those years." \ am sure that *hat you sawiM final examination for graduation 
has not been taught in all the schools, in all the classroons, to all the 
students. Oi. that conclusion, the Court .sent the case back to the trial court 
an* said to. the tri*l court, "give the state an opportunity to prove to you 
that, in fact, the test items are taught." But noting the racial implications 
of tjje test itself, how grossly out of proportion fa i I ur e rates are for black 

students, the Court went on to indicate that even if the. Court was assurecj that 

* a 

what wis tested is *hat was taught, .if the racial disproportion of test results 

remained, the Court must ajso establish that there is not a racial basis for 

those test results. jThe Cour t must aeteimine vOiether the scores are a result 

of past denials of educational opportunities or ongoing discrimination in the 

• *** 
educational systrni of the state, or something else. 

The Flor ida case, there fore, presents two sets of cla ims agaj^st the 

accountability programs. The first set^pf claims is fairly «ega*l concerning 

racial discrimination in education and the ongoing effects of that past, 




58 



65 . 



/ /• 

f * 

di scr tninaUon and tie impact of current acts in $\ scr hiination. In addition, 
the Florida case presented some very viable and somewhat novel legal issues on 
behalf of every student in^the school systcn regardless of race, language 
background, or handicap. Those claims are rooted to, and fundamental to, 
accountjibil i ty • fst we, in fact, imposing syst'ems of educational account-* 
ability io*, which we are asking people to del iver what they say they are 
delivering? Those claims will affect not only students but, as we 'shal I see, 
teachers and teacher candidates, the Florida case is being tried again and 
repMcated ia the stats of Georgia. That decision will be forthconing in a 
coupl e of weeks. And i t may we I I be re pi icated in some other j ur i sd ict ion . 

In addition, though, there are some other types of claims rtot addressed in ^ 
the Florida litigation or in the Georgia litigation which also affect the 
delivery of educational services. There has not yet been a claim presented by 
limited-English speakers. Are those i nd i v idual s of fer ed fair opportunities to 
learn'the language, and do the tests give a fair chance*for th^e^ students to 
demonstrate proficiency? There has been, however, a successful lawsuit brought 
on behalf of handicapped students who were subjected to a test for diplcma. "IiY. 
that case, a school "district sued the New York^ Conrmi ssioner of Education <hi ~ m 
behalf of two * hand i capped students who had failed the ccmmi s s ioner 1 s competency 
test. The school district refused to deny^lthe diploma to those students, 
though, saying that the students had successfully completed their schooling, 
and had successfully progressed through the ir ind iv idual i zed educat ionai 

* 7 

program. They were entitled to diplomas. The ccmmi s s ioner 1 s testing program, 



which did not acccmrodate handicapped students, was unlawfully discriminatory 
against those students on the basis of their handicap. A decision handed down 
in February, by a New York state court, held that under federal statutes 
concerning education for handicapped, as* well' as New York statutes and the 
Constitution, a test for diplomas, when handicapped student s;do not have a fair 
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opportunity to participate, is unlawful. Nbte that the key to the &w York' 
judge's decision was not the special education statutes. In fact, for the most 
part, he dUcounted those. The judge's decision was based on Constitutional 
due process. There is a notice and phase-in requirement wh-ich is important 
because it gives students fair opportunities to prepare for the test. The New 
York judge heard some/ expert testimony which indicated that handicapped 
students need to be gkyen even more time to prepare to pass a minhum conpe- . 
tency test' than^her students! He alludes to the fact that the time period' 
should be rather leV*C So the timing is important, and extra time may need' 
to be important to handicapped students. On thaf* basis, a. New York^ judge'said 
that it was unfair to deny diplomas to handicapped students. A similar case 
has just been initiated in Illinois. 

There are a couple of other sets of tissues which might be coning d$wn the ' 
road. Given the. present conservative attitude o.f the country, I suspect that 
there fliay bechal lenges either by^students or by teachers to the inclusions in 
certain-of these accountability assessments, of questions which infringe, upon 
people^ religious ..or political beliefs. Sone /min hum cOTp^tency testing 
questions *l have 'seen would offend 'the Pope because they ask about\ reproduc- 
^X^"non. Others *ould offend feminists because they depict very traditional sex 
roles in the family. Others would offend certain Indian groups- because they, 
imply some values which I think are not universally shared* 

* I 

There is the potential for new litigation concern ing* the extent to which 
.the tests^ are rel iable and \OVether mi n Inun conpe tency \e$t results reflect 
educational inadequacy. To explain what I mean let me 'also explain how I think 
this may be the Way in.*Kich these accountability efforts wil l' cone back not 
only to haunt educators but to ptlr^T^in the face. I think the test for, 
^ diplona and the other kinds of aicoun tab wlty you h^. described **re, Hn part, 
a response to t**e ^oZc>^e^ducat ional rhalpractice cases wtiich cane "Tut in the 
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early 70's. These were cases in wh icfrxstudenfs who had been given diplomas but 
who cont i nue to be f unct ional ly ill) tera te sued the i r school districts for 
• damages, alleging that they -have been victims of malpratice by educators. 
Every one «o,f those cases was unsuccessful. But the* po*Mtlcans who pass these 
kinds of accountability requirements never really recognized *that those law- 
suits were unsuccessful. I think it was an attempt to protect themselves that 
they began implementing these kinds of' accountabl I i ty schemes. Jt is^very 
possible, howeve?^fthat instead of allowing tile educat ional system to wash its 
hands of some of the allegations of .educational incompetency, people may use 



forprfai 



low test per fornrfance as a part of an indication that the educational system is 



V notfunctioningwell. If you define a min imal campe tency program, that is, the 

minimun standards' of education in your state of in your school district, you 

• - * 

■are defining what v a minimal level of edi^ation for every student, in your state 

w 

or school district is to be* Once you define that minimal level, th£ presimp- 
o tion is that you c^n deliver those educational services to rro*'t x students. 
There may be same exceptions, but for most students at that level a service can 
be * provided. - For students, I ike my cl Tents itj, Florida, successful I y to 

7 

progress through the system working on that kind of minimal adequacy is an 

accountability scandal. If a student progresses, receives good grades, passes 

* * * * 

exams, and then, with a nutter of his or her colleagues, 'fails the minimun ' 

competency tests, overnight I eg i t imately pr esime that the reason for failure is 

some dysf unct ion ' in the educational ^system. It might be. called malpractice 

•7 

became it results in a failure/to provide the student the minimal level of 
education which, you define f\n your performance standards or your objectives as 
A that which was reasonable for alh.students and teachers to obtain. In the 

future, therefor^, I see people using minimum competency, test results^ to 
attempt to g^t a foot in the door tm a way they <couid not have done with 
educational malpractice suits. And you may find people using the results. of 
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'educational- malpractice suits. And you may find people using the results of 

© * 

your tests to challenge the success of the educational system, that challenge 
might well be linked to a school finance challenge because many of the.artfas in 
which test performance is lowest are also areas in which there would appear to. 
b,e a disproportionate alloctionof educational -resources, .^he, m 'j n hum 
accountability lawsuit might also include a challenge to the,, way schools' 
finances are distributed in the state. That, I think, will very possibly be 
the new direction for suits related to^students. * 

; Because my time is running out, let us talk about how these issues wi I I 
affect teachers. Certainly the minimal adequacy I awsui t- makes an impact on 
teachers, although I think it-would be-ver^ difficult to detemiine how 'an 
individual teacher could be responsible for acts in which many people are 
involved. Note, however., that Student performance on standardized achievement 
tests has been used successfully' in the past to determine .teacher tenure and to 
detemiine teacher discharge. There is'aV-lowa case", the Scheelhaus case, in 

* * 

which a teacher was j^ccessf ul ly di scharged ^because her -fourth grade class' did 
rrot achieve 'the educational advancement the school district expected on the 
Iowa tests of basTo skills." The teacher organizations are quite' logically 
asking whether, in theyiear Tutur e , teachers wi I l^be evaluated on the basis of 
student performance- on mjn imifn competency for state-wide assessments, and with 
the little bit of guidance. we have, indications are that that could very well 
happen, and the teachers csuld be 0 very successfully discharged on thaTbasis. 
The Is^ue of assessment^ teache*rs t i ther .as potential teacher candidates, or 
for their classrocm effect iveness, is similar to the students' analysis, but 
only in a limited way. itHs in a limited waV because^the ham which will 
result, or the harm which will.be caused by the; use of the test 'to anake it a 
significant decision about a teagj^-or a potential teacherXf not quite the 
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same as the harm vtfiich resulted in Florida, for example. The harm in Florida 
wa? over^be^lm^ of access to higher education and to the job 

market were clear. In the case of the teacher, someone denied access to a 
teacher training program or to a particular job in the teaching profession is 
not quite as significant. There are other recognized alternatives. There is 
.al so more freedom of choice for ' cither a teacher training candidate or a 
teacher. The students in Florida have no choice but to go to school, and they 
had no choice about what school to attend. The teacher training candidate has 
much more choice, although J suppose that may be limited if ^he teacher 
traini ng candidate real ly only had one state institution, for example, to % go to 
be trained to be a learning disability teacher. ^Because of those differences 
in the impact of the testing program, I think the issue or the match, for 
example, between teaching and learning is a little different. As a-teacher 
training candidate,' if I am not getting the instruction I need to be certified 
in your state, I can go somewhere else to get that intruction. The issue of 



the job-rel atedness for some of the instruments used to assess teachers I think 



tinmen 

is a very real one. There might b£ significant potential difficulties for 



those s invol ved in perpetuating those tests; this is one area in which the legal 
mandate is quite clearly demanding more than I think the profession will 
deliver. I am not sure that we can say what makes a successful teacher, and I 
am not sure that we can say how we can assess that with a paper and pencil or 
an observational measure. I do ' see the potential for mounting successful 
challenges to those kinds of teacher accountability efforts. I suspect this 
because they watch and participate so closely in kinds of work we have done on 
behalf of the students, and I think that they are thinkJng very seriously about 
taking some of the lessons learned in the minimum competency testing contests 
and applying then either to teacher accountability or to provisions to limit 
access to the teacher profession. ! do not think that any of you are going to 
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be slmltarly harrased as^lo Florida. You have the benefit of learning frcm the 
mistakes that Florida made, and they are mistakes that are related to the 
context In nOi ich the SEA was placed. The SEA was asked to do the Impossible, 
and I think the only criticism I have of the Florida SEA is that It did not 
clarify that point to those *ho asked th<m to do it. The lesson is that \vhen 
you feel you are being asked to do the impossible by a legislator, by a state 
board, by a cornii ss ioner know vtoat you can deliver and know how quickly*you 
can deliver it. If you are asked to do something that you feel professionally 
unconfor table with, say so. And say- so, if you can politically, in a pifclic 
way. Those of us who scrutinize these ca&es because our clients ask us to do 
so are not going to challenge you personally for acting if we feel that you 
have made a -'good ^f fort to attempt to do your best, and if wc, fiel that you 
exercised your profess idnal responsibility. I doubt that most of you wi.l r\ever 
be defe/Wamts 'in lawsuits because you can avoid that by exercising your best 
proftfssionajl jud^nent and. by engaging in good professional practices. 




IV. DISCUSSION OF THE ISSUES 

During the course of the sympbsiun, there *er$ many occasions .Men 
questions arose Which inspjred spirited exchange. The following is a brief 
s-umpary of those questions and the interactions they 'fnspfcred . 

> 

Educational Malpractice and the Burden of Proof 

Q: Would Dr . Pul I in-cornmerit on educational malpractice? 

Dr. Pul tin! . % 1 1 _ i s difficult to sue* for malpractice when no standards 
j\kre set. -In the past, malpractice suits have* been 
'unsuccessful . Now that states are setting standards, 
opportunity for educational malpractice is renewed, 
although it Is still very difficult to say \*hat teaching 
practice i s. 

Dr. McDonald: If standards are set, why shouldnjt people sue? Educa- 
# ^ tors just have to be aware- of the possibilities. . • _ , 

f ' • ' . * 

Q: But is it possible to prove that the elements tha4 are tested were, in 

" fact/ taught? . * , * 

Dr. Pul I in: In Florida, only the remedial classes could be descrjbed 
as "teaching to the test." 1 ; 

Mr. Nix: .A process of review is the only way to accomplish the * 

- task — a process vthich constantly compares what students 
* should know versus svhat teacher s' have taught then. 

* 

Ms. Lindheim: And you must make those comparisons when^yoj^re formm-g^ 

the program and when you're evalua-ting it. * , • 

Q: But what constitutes proof? * , -7- ■ • \ 

Dr. Mcbonald: You have to determine whether "you 1 ve'taught it and the ; 
. kids haven' Mearned it yet," or whether "you've taught 

it and the kids can't learn it." Wouldn't* yoto have to \f 
show some kind of systematic deficiency? m 

-Dr. Pul I in: No l*egal standard -of proof has been set, and I wonder if 
x 'it can be. How can you prove what has occurred without 

being in al I *the classrooms? 

* * * « • 

Ms. Lindheim: You'd have to hatv„e a very thorough expl anat ion of vthat 
the test is measuring and thereby focus the issue. 
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Dr • Pul I In: , ^ Probably yolP d have to give a general assurance of, the 
relatedhess of the program, the teaching, and t|ie test- 
ing. Likely, the Court would expect the local school or 
the state to establish a currlcular match. And'since 
.criteria for proof doesn't exist, you'd ask the Court to 
define the standard of proof first, and it would probably 
be minimal . , • 

Mr; Levinson: There is.no consensus of opinion'in this area. With a 
4 shit£jDf power from the LEA to the SEA, and the, develop- 
ment of 'state ratings, the state would probably have the 
burden. 1 

Dr. Majetlc: The Court wouTd *reafly be asking^ for a rational vs. an 
arbi trary 'measure. It would want to know that there has 
been some attempt at the development of a rational answer 
to a difficult problem. The Court wouldn't necessarily 
scrut in i ze beyond that. 

• \ k . . 

Mr. Nix: That's good, because connecting. deficiencies with progran 

parts i s di f f icul t . < 

Dr.- Evans: I agree — how do we find the breakdown? Although too 
many times, we substitute a new program for analysis. 

* Minimums and Maximums », 

How do*we prevent mirtimums fron becoming maximums? 

Ms. Li ndhk hi: There are several things you can do: 

t * ( I) be clear in your expectations, . * 

(2) be sure test-makers have an explication of each test 
i tern, .* * 

(3) know *hat you want so you will know when th* students 
have learned, and 

(4) involve lotslof people in establishing minimum standards 

But who 'dec ides who is to be educated? In publ-ic school, everyone wants 
in — how do you do 1 1? 

Ms. Lindheim: Make people think the program and' the testing are working, 
and perhaps teach to the test. 



to. Nix: ^ , But lay people don't have a consensus on the minimums any 
more than we do. > « * 

to. Levinson: But they, dr groups of them, can either put pressure on the 
public 1 school or opt out. You have to think about who has 
, ' political power . ' Certainly, thfcr^are social rewards for 

the elite in other school settings, and in times of scarce , 
employment — what good is the mln huntf^The value of vtoat 
you have deperfds on what others have. 

• * > 
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Ms • Dav idspn: So it coul d be that mi n hums may 1 actual ly btmp al I 
standards upstairs* 



Ms* Lindheim: And we 1 1 1 see who has the power* A diploma does have a 
value- to ^ome people* And litigation comes fron the 6 
disadvantaged, especially if the rich go to privte school* 

Or; Evans: t In Mi ssissippi , most kids are in pub I ic schools. 8% are 
in pr ivate schools • 

Mr* Hamilton: In Louisiana, 10-1 236 of-our kids are in private schools, 

many of which have no interest in accreditation. Of course, 
as times get harder, it's difficult to say how much the 
parents are going to want to , support these private schools. 

9 

Or. Pullin: As to prevent i ng mi n imims from bee omi ng max ionics, plan lots 
of program phase-in time. Begin at the el mien tary school , 
and alter the system over ^jnwrtoward higher standards. 



, NomvReference^yests vs . Cr i ter ion-Refer ertced Tests 

Both noim-r efer enced tests and criterion-references tests look the same 
tome. Could someone he I p me see -the differences? 

Ms . ,Li ndhe im: It is important to remember how the instrument is formed. 

In a norm-referenced test, you are measuring a students's 
attainment against the attainment of a group of otKer 
students. You do rrot necessarily learn whether Student A 

^ rrjastered a particular skill or body of knowledge, but you 

do have an idea of vtfiat Stud^fit A learned as compared wi th 
what the other students learned. Perhaps no one mastered 
the skill or the body of knowledge, but the students are 
not measured against that. In a criterion-referenced test, 
*they are. One designs the test to measure an individual 
student against a stated standard. Ideally, one learns 
whetheV or not that student's learning measure^ up to the 
* standard — that is, Student A^J id master the skil I or s/he • 
did not. The two tests'ca'll for different analyses, and tc/ 
choose one over the other, one must determine why one is 
testing, and *hat, specifically, one wants to know. 

Accountabi i i ty , Money , and*Ef feet iveness 

I've, been thinking about the uses of accountability outcomes. Does anyone 
have data regarding the impact of money on school ou^fgmes? 

Dr. Evans: ■ Mississippi doesn't have any actual dfla regarding thejmpapt 
of mone.y on achievement, but it seems to us that there mjght ' 
not be a positive correlation. ' 
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Mr.. Nix: It's the sarfc thing In Texas, Vh don't have any data, 

cither, but we do have at least one urban school district 
which has had several moneyed programs — an abundance of 
riches — and s jt 1 1 1 has low achievement. We have other 
districts that have much less money and higher achievement. 

Ms. Davidson: Qf course, just because that district has moneyed programs, 
they're not necessarily good programs, or programs effec- 
tively taught. Mone^sn't the only variable there. 

Dr. Evans: True, ftjt we're not seeing high achievement In all those 
h?avily r f inanced Ti tie I schools, either, tfiough I know we 
have to consider student socio-economic status in those 
results. 

Dr. McDonald: The Educational Testing Service has found a negative corre- 
lation between paraprofessional s and outcome*. Maybe*a % * 
- way of cutting money and raising accountability is, to 
el Iminate. paraprofessionals! 

j 

The Power, to Set Minimum Standards 

Dr. McDonald: As/we have been discussing al I these issues, several ques- 
tions have been bothering me. What power do we have^ to set 
minimum standards? By setting the standards, the SEA Is 
getting more and more involved in social policy issues; do 
we have the right? >\fter all, perhaps the setting of 
mlnimim standards Is inherently inequitable — for the handi- 
capped, for those who have been denied equal educational 
opportuiities for any reason, for those<*ho have difficulties 
or Inabilities Jn learning. 

And who is responsible for seeing that the standard is 
met — the teacher or the state? Wiat is fair? Perhaps 
we should leave it to the individual professional and a 
intervene where possible. After al 1 , we are talking about 
social experimentation in an area where there Is no experi- 
ence. Are we talking about needing -something similar to a 
Food and Drug Adninl straft ion for 'children's rights? Society 
j2 developing centralized functions, and It looks like states 
can dictate the curriculum, for good and bad. 
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V. SYNTHESIS AND CONCLUSIONS 

Accountability and competency standards presume that one can descr ibe* that 



body of knowledge' or that collection of skills \0ilch ever? child ought to 
master as a result of passing through public' schools in the Uhl ted States. It 
presumg? that the knowledge and ski I Is ccrnnon to every effective teacher can be 
described and taught. a # 

These presumptions, however, collide with the/multiple, conpl ex demands 
characteristic of a pluralistic society. The dominant culture of the United 
States has assumed that i rs pub I ic serv ices were based on equal dpportun i ty and 
equal treatment. It has assumed that anyone could accomplish anything if t^t 
rules were followed and the system depended upon. Yet the educational system 
flies in the face of these beliefs, saying, "No, you don't have the minimum 
skills in mathematics so you can't have a diploma/ or "It seems that you dt>n ! t 
have the necessary awareness of proper teaching methods, so we won't certify 
you to teach in .our state." Is this *the just application of reasonable 
standards, or the denial of equal opportunity, or an indication that the educa- 
tional systpm doesh't work? • j 

And if the issue is uncomfortable for the dominant culture, what are the 

i 

implications for the many othe,r cultures co-existing in this pluralistic* 
country? If a body ofknowledfee and a collection of skills should be common to 
every pUbl ic school graduate in the Un i ted States, what determines these 
designations? \Ahat does the public school .promise the student at the end of 
the prc^cess? v • , 
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• the body of knowledge and the collection of ski I I s'necessary to 

♦ get a Jobr w 

• 'the body of knowledge and the collection of skills necessary to 

inf I uence one 1 s destiny? ^ 

, • the body of knowl edge^md the collection of skills necessary to 
cope with unpredictable change? 

• the body of knowledge and the collection of skills necessary to 

support one's self-reliance? 

• the body of knowledge and the collection of skills necessary to 

function as a citizen of the U.S. working for "the greater good?" 

Are these tht mintrum skills youngsters' need? Are there others? Could some 
of the required body of knowledge conflict with a cultural value? Do students 
go to school for different purposes, and \f they do, does th^rViange their 
expectations t>f the bM/ of knowledge and collection of * sk<itts_ they should 
receive? Can someone from one culture accurately describe the mjninun 
knowledge and skills essential to someone frcm another culture? -Are there 
aspects of life in the United States *hich cut across all cultural groups, and 
are they the proper domain of the public schools? Wiat 'does an effective 
teacher in' a classroon in South^ Texas, an effective teacher in Jackson, 

Mississippi, and an effective teacher in rural Oklahoma have in conron? Can it 

\ 

o 

be desc r ibed? Can 'it be learned? 

If anyone could have poss ibly .thought that ccmpetericy and accoijntab i I i ty 
were sjraightforward' simpl e ideas, th$ symposium and this dociment .certainly 
present evidence to the contrary. , in the six-state region of the SEDL Regional 
Planning and Service Project, there are six differerit approaches and six dif- 
ferent kinds, of progran Implementation, all «of* which makjes senie within the 
individual state's historical and legislative franework. 

tven the national advisors are guided by different emphasjs. when Ms. 
.Cynthia Levinson, Conference Onager , asked each of the advi sors, fo_r a descrip- 
tion of an Ideal Accountability State, s.he received the fol lowing rfcspoiues. 
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Elaine Undhcim Fred McDonald 



* Diana Pull In 



Each grade would have 
defined expectations for 
all students. 

Local programs would be 



I would have a. problem My state would be very 
imposing standards. similar to Elaine's* 



I . woul d want a "cul- 
tural sign-off" from 



heav 11 y guided by the State, all affected groups. 



Al I programs woul d be 
monitored by measurement 
schemes. 

There woul d be I ots of 
support for the teachers. 



I woul d reduc e the 
amount of monitoring. 

I would use a* problem- 
so I ving method ;to deal 
with social ^hemes. 



/I woul d emphasise , 
^though, that there are 

many differences among 

individuals, f 

Tests would not be the 
only judge of a person. 



There is no-doubt that the "how" of conpe tency, and accountability is stiil 

entangl ed^wi th the "why," and several people are still wonder ing , "Even ,if r „we 

figure out how to have competency and accountability schemes, are we going to' 

leave someone, behind?" 

Struggling with "should we or shouldn't we" becomes a luxury in the face of 

an indignant public or a pressured legislature. And while the states struggle, 

local $£hool districts do, too. As this document was being prepared, an action 

of the Atlanta, Georgia school board was made public. The board votea* to "base 

any [teacher] layoffs on judgements of , conpe tence rather than seniority. •• 

No final .decision has been made on the criteria for measuring conpe- 
4 tence, but according to a draft proposal ,'we Ight would.be given to 
several factors, including senorlty/ eductional preparation and a 
supervi sor f s evaluation.' The new pi an is to take effect in the 
1982-83 school year, when Atlanta will probabl y xl/dse several schools 
in the face of falling enrollment — and many job* are likely to be 
lost.". (Newsweek , June 1}^1981, p. 69) 

\ 

Competency ancl accountability issues remain compl Icted^and volatile, and worth 
everV opportunity for scrut inyl^nd reflection. The Invitational Symposiim on 
Competency and^Accountab i I i ty l s s uej^wa s certainly one of those oppor,tunl ties . 
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